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^BSTRACT 


The  estimation  of  object  boundaries  based  on  noisv 
observations  is  considered  in  the  context  of  joint 
detection  and  estimation. 

The  images  are  expressed  as  replacement  processes  and 
the  boundaries  modeled  in  terms  of  geometrical  parameters 
associated  with  the  object.  The  images  studied  have  two 
textures,  object  and  background,  characterized  by  their 
first  and  second  order  statistics.  A boundary  processor 
consisting  of  optima  estimator  and  detector  is  derived,  for 
an  appropriately  chosen  cost  function.  Differences  between 
the  cost  function  and  resultant  orocessor  with  other  costs 
and  estima tor-detector  pairs  used  previously  in  other 
applications  is  indicated.  The  optimal  solution  involves  a 
nonlinear  estimator  and  a detector  with  a variable 
threshold  dependent  on  the  estimator  output. 

Further,  because  of  information  restrictions  imposed 
on  the  estimator  that  alleviate  its  computational 
requirements,  a recursive,  easily  implementable  algorithm, 
updating  only  the  first  two  moments  is  derived,  and 
subsequently  used  to  evaluate  the  estimate  as  well  as  to 

\ iii 


perform  detection. 


Experimental  results  are  illustrated.  Of  particular 
significance  is  the  applicability  of  said  processor  under 
very  low  signal  to  noise  ratio  conditions. 

I 
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CHAPTER  ONE 


Segmentation  is  an  important  part  of  scene  analysis. 
Image  analysis  or  scene  analysis  is  that  branch  of  picture 
processing  that  deals  with  the  determination  of 
descriptions  of  pictorial  data  These  descriptions  (not 
necessarily  pictorial)  can  indicate  the  types  of  reqions  or 
objects  present  in  a scene,  or  their  characteristics  and 
interrelations.  For  instance  the  input  can  be  a 
television  image  of  a set  of  rocks  while  the  cutout  is  a 
path  on  the  terrain  for  a rover  to  move  avoiding  the 
obstacles  (rocks).  This  evidently  reauires  the 
determination  of  the  location  and  size  of  the  rocks.  Or 
the  input  might  be  an  aerial  photograph  of  terrain  while 
the  desired  output  is  a map  showing  specific  tyoes  of 
terrain  (reservoirs,  forests  urban  areas,  etc.).  Here  the 
output  is  pictoric  also,  but  it  reauires  the  specification 
of  the  terrain  type  in  addition  to  its  location.  ^s  these 
descriptions  are  formulated  in  terms  of  parts  (regions, 
objects  curves,  etc.)  in  the  picture,  it  is  cleat  that 
initially,  the  image  needs  to  be  segmented  into  these 
parts,  • 


Digital  pictures,  in  general  are  represented  by 
2-indexed  function,  .s  ( i , j ) , whose  values  are  indicative 


a 


o r 


1 


the  amourit  of  light  reaching  the  observer  from  (i,j)  and 
defined  over  a square  grid  of  NxN  points  constituting  the 
extent  of  the  image.  The  value  of  this  function  at  a point 
is  referred  to  as  the  brightness,  gray  level  or  luminance 
of  the  picture  at  the  point,  while  the  points  themselves 
are  called  picture  elements  or  pixels. 

Perhaps  the  oldest  approach  to  segmentation  is 

thresholding.  By  this  method,  the  gray  level  differences 

are  used  to  advantage  in  separating  the  regions  of 

interest.  For  instance,  given  the  image  s(i,j),  with 

luminance  values  in  [s  ,s  ] and  containing,  aay,  some 

1 K 

objects  on  a darker-  background,  then  for  an  appropriately 
chosen  threshold  t,  a new  picture  s^(i,j)  can  be  derived: 

1 if  s(i , j)  t 

s (i,  i)  ^ M.  I ) 

* 0 if  s(i,j).-t 

In  s^(i,j)  the  desired  objects  are  located  at  the 
ncn-7.erc  pixel  positions.  The  case  of  extractir.g  dark 
objects  from  a brighter  background  can  similarly  be  done. 
In  fact,  it  may  well  be  that  the  objects  occupy  a cettain 
brightness  range,  thus,  s^(i,j)  can  be  i^fir.el  is  i for 
luminance  values  in  such  a range  and  eerc  elsewh'^r'’.  Tnis 
technique,  however  simple,  preserits  several  i i sa  Ivar.tT.’es 
resulting  in  part  from  the  picture  deper,  lent  thresholi, 


1 


also  the  fact  that  in  many  applications  the  regions  of 
interest  may  be  characterized  by  other  properties  besides 
gray  scale  differences  and  most  important,  the  fact  that 
thresholding  results  deteriorate  rapidly  as  the  degradation 
(noise)  in  the  original  picture  is  more  pronounced. 

Several  ways  to  alleviate  these  problems  have  been 
suggested  [1]:  they  range  from  selection  of  a constant 
threshold  so  that  a desired  property  of  is  satisfied,  to 
selection  of  variable  thresholds  throughout  the  picture 
[ 2]  , and  also  the  use  of  preprocessing  by  a local  property 
operator  before  thresholding  [2,3]. 

A different  alternative  to  image  partitioning  consists 
in  determining  the  locations  of  abrupt  changes  in  gray 
level.  In  monochrome  pictures  containing  homogeneous 
(untextured)  regions,  edges  form  the  boundaries  between 
regions  at  different  luminance  values.  Besides  the  step, 
other  types  of  transitions  (see  Fig.  (l.a))  are  possible, 
e.g.,  roof,  line,  spike,  etc.  but  only  step  edges  will  be 
considered,  unless  otherwise  stated.  The  step  edge 
previously  indicated,  however,  is  not  present  in  normally 
available  pictures.  Several  factors  like  point  noise  from 
the  imaging  system,  reflections  and  object  irregularities, 
and  blurring  effects  between  others,  account  for  the 
appearance  of  edges  like  the  one  illustrated  in  Fig.  (l.b). 
Maybe  the  simplest  vertical  edge  detector  is  the  one  using 
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gray 

level 


line 


line  and  step 
( a ) Ideal  edges 


( b ) Noisy  edge  superimposed  on  ideal  edge 


Fig.  1.1.  Edge  cross  sections  orthogonal  to  the  edge;  direction. 


ls(i,j  + 1)-  s(i,j)l  i.e.,  the  absolute  value  of  ay  level 
d i f fer  erices  between  pixels  in  adjacent  columns  and 

belonging  to  the  same  line.  This  edge  detector  associates 
an  edge  to  (i,j)  whenever  the  difference  is  large  enough. 

2 

Related  edge  detectors  are  [ (s(i,j)  - s(i+1,j+1))  + 

2 ^ 

(s(i,j+1)  - s(i+1,j))  ] proposed  in  [4]  or  the 

computationally  simpler  |s(i,j)  - s(i+1,j+1)l  + |s(i,j+l) 

s(i+1,j)|  , however  these  detectors  are  very  sensitive  to 
noise  and  surface  irregularities  mainly  due  to  the  small 
number  of  pixels  (4)  involved.  In  trying  to  overcome  these 
difficulties,  averaging  based  on  bigger  two-dimensional 
non-overlapping  areas  was  proposed  [51.  But  as  the 
neighborhood  size  increases,  so  does  the  amount  of 

computations,  besides,  the  transitions  are  now  more  gradual 
and  the  exact  location  of  edges  is  unclear.  Also  it 
remains  to  specify  the  region  size  to  use.  References 

[5,6]  indicate  methods  to  lessen  the  effects  of  these 

problems.  Edge  detection  (edges,  lines,  points)  performed 
on  3X3  neighborhoods  is  carried  out  in  [71;  in  this 

approach  a set  of  nine  3X3  orthonormal  masks  spanning  the 
"edge"  and  "non-edge  subspaces"  is  defined.  Edges  are 
accepted  if  a normalized  projection  onto  the  corresponding 
subspace  is  above  a selected  threshold  i.e.,  the  projection 
is  close  to  one. 

The  edge  detectors  discussed  up  to  this  point  have 


heur-  i 3t  ic 


be»^r.  heuristic  and  depehcJent  to  a great  exter.t  or*  the 
extractior.  of  the  most  prevalent  features  of  edges;  high 
derivatives  and  large  values  in  the  edge  direction.  In 
[d,9l,  however,  the  problem  of  best  fitting  an  ideal  edge 
to  the  picture  gray  levels  is  described.  Referer.ee  [SI 
star  ts  by  defining  an  ideal  edge  as  a function  F or,  a 
circular  disc  D.  Let 

I 

b if  cx  f sy  5 p 

d f b if  cx  + sy  > p 


F(x,  y,  c,  s,  p,  d,  b) 


( I . ) 


2 2 

with  c +s  =1.  The  center  of  coordir.  ates  x-y  coiricides  with 
the  center  of  the  disk.  An  empirical  function  F(x,y) 
continuous  and  constant  over-  each  grid  square  but  arbitrary 
otherwise  is  also  defined.  The  task  of  the  operator  is  to 
best  approximate  a giver,  empirical  edge  E with  the  ideal 

t 

element  F so  as  to  minimize 


[E(x,y)  - F(x,  y,  c,  s,  p,  d,  b)]  dx  dy 


(1.1) 


D 


Instead  of  carrying  out  the  minimization  (1.3) 

directly,  first  a Fourier  expansion  of  E and  F in  polar- 

coordinates  is  performed,  and  then  the  resulting  expression 

is  truncated  after  eight  terms.  Let  !h.}.  „ be  the  basis, 

1 1 = 0 


min 


(1.5) 


E 


i = 0 


w^[  a.(x  , y)  - s.(x,  y,  c,  s,  p,  d,  b)  ] 


with  representing  weighting  coeffients  with  values  close 
to  one.  Truncation  to  only  eioht  terms  is  justified 
because  edges  are  usually  blurred  and  blurring  removes  high 
spatial  frequencies;  also  noise  effects  are  more  adverse  at 
higher  spatial  frequencies.  This  operator  returns  the  best 
edge  and  a measure  of  confidence  on  the  fit. 

For  an  optimal  approach  to  line  detection  in  the  block 
world,  see  [10,11]. 

In  regard  to  the  edge  detection  approach  to  boundary 
detection,  let  us  point  out  that  results  suffer  from  an 
excessive  amount  of  edges  not  belonging  to  the  boundary 
itself.  This  is  not  surprising  in  view  of  the  local 
properties  used  in  defining  these  detectors.  In  [12-14], 
boundary  characteristics  have  been  used  to  advantage  in 
reducing  the  amount  of  redundant  edges.  Although  the 
amount  of  edges  is  s ion  if icantl y lower,  non-boundary  edqes 
are  still  present.  Picture  noise  levels  are  a necessary 
consideration  too.  Edge  detectors  that  discriminate  edges 
very  well  in  low  noise,  deteriorate  considerably  as  the 
pictures  become  noisier  [15,16].  A host  of  methods  for 
boundary  determination  appear  in  [17,18,1],  however  their 
approach  is  via  edge  detection,  hence  they  suffer  from  the 
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drawbacks  previously  adduced. 

In  addition  to  picture  analysis,  boundaries  reoresent 
alternatives  for  data  comoression  and  imaqe  codinq  [19,201. 
A different  motivation,  thouqh , stems  from  the  aoplication 
of  linear  filtering  technioues  in  picture  restoration.  To 
illustrate  this  point,  consider  for  example  the  statistical 
representation  of  the  imaqe  s(i,j)  in  terms  of  first  and 
second  order  moments  (a  very  common  model  for  restoration). 
It  was  experimentally  shown  in  [21]  that,  two-indexed,  wide 
sense  stationary  random  processes  with  exponential 
autocorrelations  of  the  form 

cov[s(i,j)s(i  + i,j+m)]  = ue'^^^^  (1.6) 

represent  suitable  models  for  the  imaqe  s(i,j).  Further 
use  of  (1.6)  to  derive  linear  dynamic  models  driven  by 
white  noise  and  the  use  of  minimum  mean  sauare  error 
criteria  resulted  in  linear  Kalman  filters  as  restoration 
algorithms  [22-26] . These  filters  represented  real-time, 
recursive  type  procedures  applicable  even  under 
non-stationar ity  assumptions.  wiener  filters  were  also 
derived,  on  the  other  hand,  bv  using  second  order 

[ statistics  and  the  same  error  criteria  [27, 2R].  However 

[ 

j pictures  restored  by  said  methods  consistent  1 y mani fest  a 

I blurring  of  the  edges. 


H 


To  develop  an  understanding  into  the  causes  of  this 
edge  blurring,  note  first  of  all,  that  representing  the 
image  by  its  mean  and  autocorrelation  functions, 
corresponds  to  aggregating  the  statistics  from  different 
picture  entities,  most  importantly,  textures,  border  lines 
and  region  geometries.  Second,  that  the  application  of  MHS 
criteria  result  in  linear  algorithms  (the  Wiener  filter  is 
certaintly  one)  that  produce  estimates  at  every  pixel  based 
on  the  whole  picture  data  (or  at  least  a big  area)  in 
general  comprising  several  textures  or  regions.  The  direct 
effect  of  the  latter  point  is  a global  smoothing  of  the 
data  with  the  subseguent  worsening  of  edge  sharpness. 
Indeed,  in  representing  images  in  terms  of  processes  with 
statistics  as  in  (1.6)  (equivalently  by  using  first  and 
second  order  statistics)  , the  geometric  characteristics 
within  the  image  have  been  undermined  to  such  an  extent 
that  their  recovery  (estimation)  is  hampered.  Hence,  in 
accounting  for  the  geometry,  the  model  (1.6)  is  wanting. 
In  remedying  this  condition,  images  were  formulated  in 
terms  of  "replacement  processes"  [29-31]  (see  also  chapter 
two).  These  models  bring  up  explicitly  both  picture 
aspects:  texture  and  geometry.  Early  restoration  results 
[321  showing  better  defined  boundaries  are  supporting 
evidence  of  the  available  improvements  obtained  with  the 
new  formulation. 
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The  first  application  of  the  reolacement  model  to 
boundary  estimation  apoeared  in  [29].  Said  application 


involved  an  aoproximate  maximum  £ oos  ter io  r i (MAP) 
estimation  of  parameters  representinq  the  first  and  last 
lines  where  the  object  is  present  as  well  as  the  initial 
and  final  pixels  delimitinq  the  same  between  those  lines. 
This  recursive  estimator  suffered  from  several 
shortcominqs,  the  most  prominent  involvinq  the  ad  hoc 
estipulation  of  variances  in  crucial  transition  densities 
of  the  initial  and  final  pixels  in  lines  occupied  by  the 
object.  Further,  it  has  application  to  pictures  with  only  one 
object  (there  is  one  initial  line  and  one  final  line). 

More  recently,  preliminary  results  obtained  in  [33] 
with  a MMS  estimator  for  boundaries  in  pictures  represented 
in  terms  of  replacement  orocesses,  unveiled  a new  approach 
for  boundary  determination  which  will  be  tne  subject  of 
this  dissertation.  Unlike  [33]  where  ad  hoc  procedures  of 
boundary  rejection  were  necessary,  this  new  approach 
accounts  in  an  optimal  manner  for  the  absence  of  the  object 
at  any  line.  In  addition,  the  alqorithm  is  not  constrained 
to  process  one-object  pictures.  Of  particular  interest  are 
its  recursive  on-line  ooeration,  use  of  onlv  first  and 
second  order  statistics  and  ability  to  operate  under  severe 
noise  environments. 

The  followina  is  an  outline  of  the  succeedinq  nanes: 
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In  chapter  two,  the  subject  of  boundary  estimation  in 
tne  context  of  the  replacement  formulation  is  taken  up. 
I'flien  the  images  are  two-textured  and  contain  horizontally 
convex  objects,  the  boundary  function  (process)  is  shown  to 
be  ad vantageousl y expressed  in  terms  of  two  parameters  with 
clear  geometric  meaning:  width  and  center.  The  images 
considered  are  characterized  statistically  in  terms  of  the 
first  and  second  statistics  of  the  textures,  the  noise 
degradation  and  the  width  and  center  statistics  (Markovian 
sequences ) . 

Chapter  three  elaborates  on  the  type  of  structure 
necessary  to  perform  boundary  estimation  and  finds  the 
optima  detector  and  estimator  that  minimize  the  average 
cost  of  joint  detection  and  estimation  for  a desired  cost 
function.  Furthermore,  estimation  and  detection 
algorithms,  recursive,  easily  implementable , updating  only 
first  and  second  order  moments  are  developed. 

The  processing  of  binary  pictures  and  experimental 
results  are  presented  in  detail  in  chapter  four. 

Finally,  chapter  five  discusses  other  possible 
algorithms,  the  use  of  different  cost  functions  and  topics 
for  further  research. 
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CHAPTER  TWO 


Problem  For  mulaticr, 


Pictures  are  subject  to  many  different  types  of 
degradations,  stemming  from  camera  motion,  out-of-focus 
imagery,  atmospheric  turbulence,  background  radiation, 
quantization,  to  name  a few.  As  a result,  in  practice,  the 
original  gray  level  values  of  an  image,  s(j,m),  are 
unavailable  for-  measurement.  Instead  of  s(j,m),  a degraded 
form  (the  observable  image),  y(j,m),  hereafter  called  the 
"observation,"  is  available.  Many  times,  the  original  is 
corrupted  by  some  type  of  noise.  Some  of  these  are 
uncorrelated  from  point  to  point,  others  are  not  (noise  due 
to  the  presence  of  TV  raster  lines);  some  are  independent 
of  the  picture  signal  (channel  noise  introduced  during 
transmission,  scanning  noise  from  a vidicon  television 
camera),  while  others  are  not  (photographic  graininess, 
flying  spot  scanning  noise)[1].  In  this  work,  we  will  be 
concerned  with  the  more  comr,.on  types  of  distortions, 
namely,  those  modelled  by  additive  noise. 

On  the  planar  grid  ( doubl e- index  el ) wh»r e the 
obser  V at  ior.s  y(j,m),  j,m=1,...,N  are  defir.  el,  it  is 

possible  to  assign  also  a temporal  ordering,  k.  For  a 

I 2 


m 


picture  already  available,  this  latter  orderinq  might  be 
artificial.  On  the  other  hand,  it  can  be  indicative  of  the 
image  generation,  i.e.,  the  successive  availability  of  the 
elements  in  the  sequence  of  observations. 

Ordinarily,  when  an  image  scanner  is  used,  the 
temporal  order  indicated  by  k is  directly  related  to  the 
scanning  process.  In  the  following,  a line  by  line 

scanning  will  be  assumed,  left  to  right  and  from  top  to 
bottom.  Hence,  the  ordering  rule  becomes: 
k = ( j - 1 ) N + m 

j = 1, N 

( ^.  1 ) 

m = 1 , . . . , N 

k = 1, N^. 

The  images  that  will  be  dealt  with  are  all  expressed 
in  terms  of  replacement  processes. 


Replacement  Processes  : In  its  general  form  (in  the 
image  context) , a replacement  process  involves  a set  of  M+1 
binary  valued  (1  or  0)  functions,  defined  on  the  image 
mesh,  satisfying  the  following  relation: 

m ! 

y]  X (k)  - 1 { 2.2  ) i 

* i 

1 = 0 i 


2 

for  any  k=l,,..,  N . Relation  (2.2)  indicates 
one  function  can  be  non-zero  at  any  time  k. 


that  only 
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In  the  reoiacement  process  formulation  of  a oicturo, 
it  is  assumed  that  the  image  consists  of  a set  of  'objects" 
defined  over  the  entire  picture,  each  of  these  associated 
with  a function  , and  that  the  picture  luminance  values 
can  be  written  as: 

tti 

s^(k)  >.^(k)  ( ^.  3 ) 

1,  = 0 

z 

k=l,...,N  , where  s^  represents  the  qrav  level  values  of 
the  ob j ect  1 . 

It  is  worthwhile  to  note  from  this  representation 
tnat:  1)  at  any  pixel,  only  one  object  is  present,  i.e., 

there  is  no  superoos ition  of  object  luminances,  2) the 
functions  ^ , being  binary,  carry  the  object  boundary 
information  without  providing  insight  as  to  the  pixel 
(local)  properties  of  the  objects  themselves. 

Of  particular  interest  in  the  sequel  is  the  case  when 
f1=l.  Relation  (2.2)  becomes: 

\ (k)  + X , (k)  = 1 ( 2.  4a  ) 

0 1 

which  is  rewritten  as 

1 1 - X(k)  1 + X(k)  ^ 1 . ( 2.4b  ) 

Relation  (2.4b)  simply  indicates  that  knowledqe  of 
either  binary  function  (X^^  . X^  ) is  all  that  is  needed.  By 
convention,  from  here  on,  the  binary  fum  tion  X , referred  to  as 
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the  replacement  function,  will  characterize  the  object 
location.  This  imolies  the  assignment  of  (l->.  ) to  the  so- 


called  background  (the  object  with  luminance  ) . 

Let  us  illustrate  the  replacement  formulation  by  a few 
(1 ) 

examples.  Fig.  (2.1a)  shows  an  image  containing  a square 
(object)  of  gray  level  value  s^  on  a background  of  zero 
luminance.  Along  with  it,  also  indicated,  are  the 
luminance  of  the  object,  the  replacement  function  on  three 
typical  lines  and  the  image  brightness  function. 
Fig.  (^.Ib)  depicts  the  same  set  of  functions  indicated  in 
Fig.  (2.1a)  as  they  apply  to  a picture  containing  two 
rectangles  having  the  same  constant  intensity.  However, 
because  objects  are  defined  by  assumption  on  the  whole 
image  plane,  their  grey  level  functions  are  identical. 
Hence,  only  one  replacement  function  is  used.  Even  more, 
when  the  object  appears  repeatedly  throughout  the  image,  it 
is  clear  by  the  preceding  method,  that  only  one 
replacement  function  is  necessary.  The  two  schematic 
pictures  appearing  in  Fig.  (2.2)  besides  representing  two 
more  examples  of  the  replacement  process  formulation,  serve 
to  introduce  the  concept  of  'horizontal  convexity"  as  used 
in  [29] . 

[ Hor izontal  Convexity  : an  object  is  said  to  be 

1(1)  For  clarity,  the  diagrams  are  drawn  with  continuous 

1 ines. 

I 

^ ^ 


j 

j 

! 

I 


I 


horizontally  convex,  if  whenever  two  oixels,  locate^l  on  the 
same  line,  belong  to  the  object,  then  anv  oixels  between 
them  also  belong  to  the  object-  - let 

O = j object  pixels] 

if  (j,m),  (j,n)eO  andm<n,  then  (j.m-t-l),...,(j,n-l)£^>. 

Examples  of  objects  satisfyino  this  orooerty  aooear  in 
Fig.  (2.1)  and  Fig.  (2.2b).  while  Fig.  (2.2a)  shows  an 

object  that  is  not  horizontally  convex  as  is  evidenced  from 
the  olots  of  X(k)  on  line  b and  the  image  brightness 

f unct ion . 

The  purpose  of  this  work  is  the  develooment  of 

recursive  algorithms  applicable  to  the  determination  of 

boundaries  of  horizontally  convex  objects  from  observations 
where  the  degradation  Phenomena  are  characterized  by 
additive  zero  mean  white  Gaussian  noise  of  variance 
viz  , 

y(k)  = s(l<)  + v(lc)  ( 2.  5 ) 

k = l f]^.  In  images  with  brightness  values  given  bv 

s(k)  = X(k)  s^(k)  f fl  - X(k)l  Sj^(k)  ( 2.  i ) 

Z 

k = l,....!‘4  . With  3 , s , reoresentinq  the  gray  scale 

o b 

values  of  the  object  and  backaround  resoect  iv^l y . two 

statiscally  independent  cyclostationary  random  seouences 

whose  first  and  second  order  statistics  are  known 

[21.34,351.  The  statistics  of  the  replacement  function 
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(sequence)  of  >.  in  (2.6)  are  also  known,  but  these  will  be 
specif ied  later . 

Note  that  due  to  the  definition  of  >.  , and  in  view  of 
eauation  (2.6),  the  determination  of  the  object  boundary 
itnolies  the  determination  of  the  reolacement  function  and 
vice  versa. 

Let  us  consider  more  carefullv  the  seauence  of 
observations  indicated  in  (2.5),  (2.6).  There  will  be  some 
ones  belonqinq  to  lines  where  >.  (k)  is  zero  evervwhere, 

i.e.,  the  object  beinq  absent  from  t?hose  lines.  On  other 
lines,  X(k)  will  be  unity  or  zero  on  some  pixels, 
depending  on  the  observation  origin,  whether  the  object  or 
the  background.  This  consideration,  then  allows  us  to 
dichotomize  the  set  of  observations  (2.5)  as  follows: 

Hq  : y(k)  = Sj^(k)  + v(k)  k e 

: y(k)  = X(k)  s^(k)  + fl  -X(k)]  Sj^(k)  + v(k)  ( 2.  7 ) 

k <! 

p 

with  I = jlines  where  the  object  is  absent]  . 

From  (2.7).  it  is  clear  that  determination  of  the 
object  boundary  entails  the  selection  of  the  lines  where 
the  object  is  present  (detection  of  the  object)  and 
secondly,  the  boundarv  estimation  per  se . It  is  our 
objective  here,  to  develon  an  ootimal  orocedure  to  carry 
out  the  combined  operations  of  detection  and  estimation  of 


L 


i 

t 


I 

i 


object  boundaries.  Let  us  beain  bv 
rear esentat i on  tor  the  binary  function  ^ . 


introducina  a 


Representation  of  the  Reol acement  Funct  ion  ^ 


The  binary  function  k reoresents  the  existence 

( k (k)  = l)  and  absence  ( k (1<)=0)  of  ooject  in  the  image  at 
oixel  k.  Each  k clearly  corresoonds,  bv  the  ordering  rule, 
to  a particular  image  line.  Hence,  it  is  possible  to 
associate,  on  these  lines  where  the  object  exists,  to  each 
k,  two  variables  w(k)  and  c{k)  reoresenting  the  width  and 
the  geometrical  center  (measured  from  the  midpoint  on  the 
oicture)  of  the  object  at  the  associated  line  (see 

F ia  . (2.3)),  For  instance,  all  k where  (j-l)H  + l^ks  jN - 

oelong  to  the  j-tn  line  and  to  each  corresponds  the  same 
width  and  center  value,  those  of  the  j-th  line.  Thus 


w{k  1 ) = w(l< ) 
c(k  t 1)  = c(l<) 


(j  - 1 ) N - 1 ^ k ^ JN  - 1 


j ^ I 


( 2.  8 ) 


Tne  functions  w(k)  and  c(k)  are  souare  wave  functions 
taking  on  constant  values  over  each  line. 

The  replacement  function  \(k).  k = l can  now  be 


defined  in  terms  of  w(k)  and  c(k)  as  follows; 


0 k e I 


(k)  = i 


(j  - 1 )N  + ^ + c(k)  - ^ k s (j  - 1 )N 


N ,,  w(k)  . , , 

f — f c(k)  +—  , j / 


N w(k) 

0 (j  - 1)N  f 1 s k < (j  - 1)N  f — f e (k)  - — , 


N w(k) 

0 (j  - 1)N  + — + c(k)  + 


j ^ I 


< k ^ jN  , 


J ^ ^ • 
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Since  the  object  width  is  a positive  quantity  and  the 
object  must  lie  within  the  image,  w(k)  and  c(k)  satisfy  the 
following  constraints 


w(k)  2 0 


( 2.  10a  ) 


^ i |c(k)| 


N 
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The  quantities  w(k)  and  c(k)  are  random  sequences  with 
known  first  and  second  order  statistics.  Let 


w(k)  - w(k)  + w 


( 2.  1 la 


c(k)  = c(k)  + c 


( 2.  1 lb  ) 


where  w and  c are  the  mean  values  respectively.  The 
quantity  w is  a rough  measure  of  the  size  of  the  object 
while  c is  an  indication  of  its  probable  (based  on  a priori 


information)  location  within  the  picture.  The  latter 
quantity  is  likely  to  be  zero  in  many  applications.  The 
zero  mean  random  sequences  w(k)  and  c(k)  possess  statistics 
which  are  measures  of  variation  of  object  size  and  of 
object  'skewness"  over  the  ensemble  of  objects  that  the 
class  of  images  to  be  processed  comprises. 

Let  us  digress  for  a moment  so  as  to  bring  out  the 
present  development.  From  the  replacement  process 
formulation  of  images,  it  was  observed  that  boundary 
estimation  was  accomplished  by  estimating  the  reolacement 
functions  (sequences)  in  the  case  of  several  objects  or  by 
estimation  of  the  replacement  function  associated  with  the 
object  when  dealing  with  images  composed  of  foreground  and 
background.  Being  the  reolacement  sequence  binary,  any 
estimation  procedures  resulting  in  non-binary  estimates  are 
unacceptable.  After  all,  an  estimate  of  X (k)  equal  to  .3 
across  a picture  is  meaningless;  what  is  needed  is  the 
location  of  the  object  if  present,  as  indicated  by  unit 
estimates  or  its  absence,  corresponding  to  zero  estimates. 
An  alternative  way  to  proceed,  instead  of  estimating 
directly  the  replacement  function  is  provided  by  the 
representation  (2.9).  The  determination  of  X can  be 
reverted  to  the  estimation  of  parameters  with  an  intuitive 
geometric  interpretation,  which  besides,  are  not  restricted 
to  be  either  zero  or  one.  This  digression  is  closed  by 
indicating  that  to  perform  the  recursive  estimation  of  w(k) 


and  c(k),  from  the  set  of  nonlinear  observations  (2.7), 
(2.9),  it  remains  only  to  establish  dynamic  models 
representing  the  evolution  of  said  parameters.^** 

Let  us  define  the  object  vector  r(k)  by 

r(k)  = f w(k)  c(k)  ] ' ( 2.  12  ) 

where  prime  denotes  transpose,  and  with  abuse  of  notation 
w(k)  and  c(k)  represent  the  real  valued  counterparts  to 
w(k)  and  c'(k)  (w(k)  and  2c  (k)  are  integer  valued). 

As  a first  order  approximation,  the  2-dimensional 
vector  r(k)  is  assumed  to  satisfy  a first  order  Markov 
sequence  , 

r(k)  = A (k)  r(k)  + B (k)  u (k)  ( 2.  1 3 ) 

o o o 

I 

where  u^(k)  = [Uj  u^]  is  a zero  mean  white  normal  sequence 
with  unit  covariance.  Furthermore  from  (2.8),  it  follows 
that 

A (k)  = I (the  identity  matrix) 

o 

B (k)  = 0 
o 

for  all  k except  k = jN,  j I^.  For  values  of  k = jN; 
j , j+1 c , (2.13)  yields 

(1)  This  assertion  is  correct  if  Sj^(k)  and  si,(k)  are  qiven 
or  if  from  the  second  order  statistics  qiven,  dynamic 
models  for  them  have  already  been  obtained. 
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r(jN+  1)  = A (jN)  r(jN)  + B (jN)  u (jN) 
o o o 

but 

r(jN+l)  :::  r(jN+2)  = ...  = r[(j  + l)N-l]  = r[(j+l)N] 

hence 

r[(j  + 1)N]  = A (jN)  r(JN)  + B (JN)  u (jN)  ( 2.  14  ) 

Note  that  r (jN) , for  j ^ represents  the  width  and  center 
values  associated  with  each  of  the  object  lines. 
Consequently,  the  matrices  A^(jN)  and  B^(jN)  determine  the 
dependence  of  the  object  width  and  center  on  successive 
lines. 

Let  us  comment  upon  the  approximation  mentioned  just 
before  (2.13).  It  is  clear  that  instead  of  considering  the 
evolution  of  c(k),  w(k)  as  obtainable  from  the  images,  it 
was  chosen  to  model  the  real  valued  parameters.  It  is 
understood  that  as  much  as  digital  images  are  a means  of 
representation  they  result  in  certain  restrictions  not 
present  on  the  natural  scene  or  natural  object,  for 
instance,  specifically,  w and  2c  are  not  restricted  to  be 
integers  on  the  natural  objects,  although  they  so  appear  on 
a digital  display.  The  oroblem  of  how  to  select  the 
appropriate  mesh  for  a digitized  picture  is  not  addressed 
here,  rather,  it  is  assumed  that  the  avialable  data  possess 
adequate  resolution  for  the  objects  of  interest  so  that 

differences  between  the  pictured  derived  parameters  and 
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their  real  valued  counterparts  obtained  from  the  natural 
objects  are  negligible. 

The  second  type  of  approximation  refers  to  the 
evolution  model  proposed  here.  The  simplicity  of  the  model 
(2.13)  itself  is  intuitively  appealing.  Besides,  it  is  in 
accordance  with  the  often  observed  feature  that  object 
boundaries  are  generally  smoothly  varying.  At  anv  rate, 
depending  on  the  available  a priori  information  regarding 
the  classes  of  objects  investigated,  this  model  represents 
exactly  those  £ pr  ior i statistics  or  it  may  correspond  to  a 
lower  order  dynamic  model  approximation  to  the  model 
derived  from  such  statistics.  Let  us  point  out,  that  in  a 
vast  majority  of  occasions  these  a priori  statistics  are 
missing.  Instead,  sample  images  are  available.  In  such 
instances  it  is  first  necessary  to  develop  the  appropriate 
statistics  and  consequently  the  model,  or  develop  the  model 
directly  from  the  given  samples  (36) . 


CHAPTER  THREE 


The  Optimal  Structure 

It  has  been  indicated  before  that  the  object  boundary 
determination,  in  addition  to  an  estimation  problem  entails 
one  of  detection  as  well. 

It  is  the  puroose  of  this  chapter  to  derive  the 
necessary  structure  for  boundary  estimation  and 
subsequently  develop  formulas  for  the  ootima  estimator  and 
detector  that  minimize  a criterion  to  be  given. 

Many  types  of  estimation-detection  problems  arise, 
ranging  from  pure  detection  where  multiole  hvpotheses 
testing  is  required  becoming  intractable  as  the  number  of 
hypotheses  increases,  to  cases  where  estimation  and 
detection  are  performed  at  every  pixel.  For  an  example  of 
the  latter  procedure,  in  the  case  of  images  modeled  as 
2-indexed  fields,  see  132,37,38).  The  detection- 
estimation  scheme  that  will  be  considered  in  the  following 
has  been  motivated  by  the  modeling  of  the  class  of  imaqes 
described  before.  To  be  more  specific,  the  model  considers 
pixel  attributes  like  the  luminance  values  of  the  object 
and  background  as  well  as  line  attributes  indicated  by  the 


object  oarameters  ( width,  center  ).  Inherent  to  the 
modelinq  of  these  last  oarameters  is  the  necessity  to  test 
the  object  existence  at  each  line. 

It  was  Middleton  and  Esoosito  [39]  who  first 
formulated  and  solved,  under  a statistical  decision  theorv 
framework,  the  simultaneous  oroblems  of  detection  and 
estimation.  Since  then,  several  authors  [39-46]  have 
considered  applications  that  involve  sianal  or  oarameter 
estimation  under  uncertainty.  Common  to  all  of  these 
appl ica t i ons , however,  is  the  assumption  that  the  siqnals 
or  oarameters  to  be  estimated  are  of  'enerav-tvoe . 

Let  us  explain  the  reason  of  the  previous  quotations 
with  two  simple  examples.  First,  let  us  assume  it  is 
necessary  to  estimate  the  amplitude  of  the  sinusoidal  waves 
produced  by  a transmitter.  Because  of  defective  components 
in  the  receiver,  this  latter  instrument  observes  the  siqnal 
and  noise  (with  known  a priori  probability)  or  noise  alone. 
Second,  suppose  that  in  a me teor o loq  ica  1 station,  where  the 
probability  of  rain  is  known  ^ priori,  it  is  desired  to 
estimate  the  temperature  of  the  water  drops  from 
observations  containinq  a siqnal  (characteristic  of  the 
rain)  and  noise  or  noise  alone.  It  is  obvious  that  both 
these  examples  involve  est.mation  under  uncertaintv. 
However,  there  is  a difference  between  them:  when  the 
siqnal  is  not  Present,  in  the  first  case,  the  received 
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amol  itud  e is  zero  and  equivalently,  for  a zero  amplitude 
emitted  siqnal,  the  observation  will  contain  noise  onlv 
(there  is  no  way  the  receiyer  could  differentiate  which  one 
of  these  alternatives  occurred).  In  the  second  instance, 
on  the  contrary,  the  reception  of  no  siqnal  is  not 
indicative  of  hail,  but  represents  the  absence  of  rain. 
Hail  itself  corresponds  to  some  siqnal.  The  amplitude  is  an 
example  of  an  "energy-type"  parameter  (as  used  in  144))  in 
tno  sense  that  the  absence  of  signal  carries  the 
implication  of  a zero  parameter  while  the  temperature  is  an 
instance  of  a "hypothesis  dependent"  parameter,  meaninaful 
only  under  a certain  hypothesis. 

The  present  formulation,  as  opposed  to  the  cited 
applications,  is  concerned  with  the  estimaiion  of 
'hypotnesis  dependent"  parameters. 

Let  us  specify  the  tasks  required  to  estimate  the 
boundaries,  and  in  so  doing,  define  the  necessary 

processor:  at  the  end  of  every  line,  it  is  necessary  to 
screen  the  observation  data  and  produce  a decision  at  the 
output,  V ^ , indicating  the  absence  of  the  object  (when 
is  decided).  When  Hj  is  decided  (Vj),  proceed  to  estimate 
the  width  and  center,  and  present  these  estimates  at  the 
output  (see  Fig.  (3.1)),  where  y.  is  the  decision 

associated  with  hypothesis  H..  In  other  words,  the 
boundary  processor  output  must  be  either  a decision  or  an 


est  ’.<^3  te . 


Ill  order  to  quantify  the  actions  carried  out  bv  the 
two  components  illustrated  in  F iq . (3.1)  costs  will  be 
associated  to  tne  detection  as  well  as  the  estimation 
stage.  It  is  natural  to  ask  at  this  point:  what  are  the 
estimator  and  detector  (decision  rule)  that  minimize  the 
average  cost  of  joint  detection  and  estimation  over  the 
ensemble  of  possible  observations  ? 

To  the  answer  of  this  question,  along  the  lines  of 
[391 , the  rest  of  this  section  is  devoted,  but  first  it  is 
necessary  to  introduce  some  notation.  Let  us  define: 
p^  , i=0,l  : the  a priori  orobability  of  occurrence 

of  hypothesis  H 

Y (j )=  jy( k) , y( k-1 ),..., y( k-N+1 ) :k=jN,  j=l,...,N] 

(jNl  Y(  j)  )^^*  : an  estimate  of  the  object  boundary  r(jN) 

at  the  j-th  line,  given  the  observation 
Y(  j)  . 

(i(v.|  Y)^'^'  : the  decision  rule  that  assigns  0 or  1 to 

each  decision  y.  , deoendino  on  the 

1 

observation  Y. 

c.  . ,i,£=0,l  : the  detection  cost  incurred  when 

1,  I 

(1)  In  tne  following,  for  simplicity,  the  arguments  of 
Y(j),  r egt  ( j N 1 Y(  j ) ) , r(jN),  6(\ilY(j))  will  he  eliminated, 
unless  required  for  clarity  of  the  context. 

(2)  This  means  that  6 (Vjy)  is  a non-r andom ized  decision. 
The  results  that  follow  do  not  make  use  of  this  condition, 
and  they  would  have  been  valid,  if  instead,  randomized 
decisions  would  have  been  allowed. 


■ ^ 
% 
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deciding  ■,  when  actuallv  occurred. 

■ i I 

the  cost  of  estimating  a boundary  when 
no  object  is  present. 

the  cost  of  estimating  the  object 
boundary  r{jN)  by  (jNjY(j)),  when  an 

object  is  present  (H^  is  true)  and  y ^ , 

has  been  decided. 

the  probability  density  of  Y(j)  given 
r(jN)  and  when  is  true. 

Let  us  comment  on  the  rationale  for  the  preceding 
costs,  before  proceeding  any  further.  First  of  all,  it  is 
clear  that  the  global  cost  of  estimation  and  detection  must 
reflect  the  various  ways  in  which  correct  or  wrong 
decisions  as  well  as  different  estimate  values  affect  the 
overall  performance  of  the  processor.  On  the  other  hand, 
the  set  of  costs  needs  to  be  defined  in  the  context  of  the 
application  and  effects  of  the  processor  implementation. 

Six  different  costs  have  been  introduced,  four 
directly  associated  with  the  detector  and  the  other  two 
directly  associated  with  the  estimator.  These  6 costs  can 
be  considered  as  element  costs  in  the  sense  that  they  apply 
whenever  the  detector  produces  a decision  or  the  estimator 
presents  an  estimate.  As  schematized  in  Fig.  (3.1) 

(1)  Similar  definitions  apply  for  p(y1Hq)  and  p(r|Hj). 
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1,0 


p (y1 r , H ) 


(1) 


thouqh,  the  nrocessor  outputs  are  qenerallv  the  result  of  a 
decision  and  an  estimation-  consequently  any  inout-outout 
relation  for  the  processor  will  inyolye  one  or  more  of 
these  basic  costs.  Thus,  in  this  latter  resoect-  the 
aforementioned  six  costs  can  be  qrouned  in  four  vTlobal 
orocessor  costs  reoresentinq  the  costs  associated  with 
orocessinq  observation  data  and  resultina  in  an  outout  be 
it  a decision  or  an  estimate.  Namely, 


H. 


H 


H, 


H, 


• — 

""i,  0 

— — 
V 

U— 

'..0 

** 

n 

o 

*• 

• — 

^1, 1 

'’i 

^ — 

r 

est 


r 

est 


In  this  representation,  the  hypothesis  shown  on  the 
left,  states  the  observation  origin,  while  the  outout  is 
specified  on  the  extreme  right.  In  between,  the 
intermediate  steos  and  accompanying  costs  are  indicated. 


The  four  element  costs  c.  were  chosen  as  constants. 

1.  i 

in  agreement  with  the  classical  orocedur e. that  assigns  a 
constant  cost  to  every  decision  whether  it  is 
misclassif  ication  or  correct  classification.  '^ore 
importantly  though,  such  selection  discriminates  (weighs) 
the  data  as  follows:  when  the  observation  data  belong  to  a 


3.1 


line  where  the  backqround  is  present  and  the  detector  makes 
the  correct  decision,  then  c^  ^ represents  a fixed  charqe 
in  usinq  the  detector.  When  the  data  belonq  to  a line 
where  the  object  is  present,  if  the  detector  oroduces  a 
wronq  decision  (misses  the  object)  then,  the  detector 
incurs  a penalty  c^  ^ . Note  that  this  oenalty  is  imposed 
reqardless  of  the  object  (of  the  object  parameters) 
involved.  Note  also,  that  the  previous  charqes  (c  or 

W , I 

Cq  g)  are  the  only  costs  the  processor  will  incur,  for  any 

observations  resultinq  in  the  output  decision  \q  . Similar 

remarks  apply  to  c r,  and  c . However,  as  in  both  these 

1 , U * » I 

cases  the  processor  operations  are  not  restricted  to  the 
detector  but  include  the  activation  of  the  estimator  as 
well,  the  effect  on  the  data  is  better  appreciated  in 
combination  with  the  estimation  charqes. 

As  a starter,  the  Pair  c n apolied  in  those 

instances  where  the  data  are  wronqly  classified  resultinq 
in  estimates  of  nonexistent  objects.  The  cost  c^  ^ 
penalizes  any  such  decisions  stemminq  from  the  detector. 
Penalties  for  the  estimate  are  not  clear.  This  is  so, 
because  all  estimated  parameters  are  undesirable,  in  fact, 
they  are  meaninqless.  A constant  estimation  cost  (f^  ^)  . 
however,  assumes  the  absence  of  any  ’preferred'  estimates 
and  it  is  therefore  chosen.  Finally,  there  is  the 

selection  of  f,  , • the  object  is  oresent  and  an 

estimate  is  produced,  the  fidelitv  of  reproduction 


criterion  should  mandate  the  form  of  this  cost  function. 


In  general  though,  it  is  a function  of  both  the 
parameters  and  their  estimates  and  as  such  it 
indicated  by  fj  j(rggj.,r). 

Recall  that  it  is  necessary  to  determine  the 
cost  of  joint  detection  and  estimation 
previous  definitions,  it  follows  that: 

^ ^1  ‘^0,  1 ^ ''1 

* ‘(V||V)[p„Ci  oP(YlH„) 

Y Pj  ^-,1  < P(Y|r.Hj)  > r] 

* ''(V,IV)[Poti  oP(YlHo) 

= ' ■iy|6(VglY)(PoC|j^ljP(Y|ng)| 

+ ^(VqI  Y)[pj  I < p(Y|  r.  H|)  > r| 

' Mv,|Y|  P|  <[C|  J , f| 
p(Ylr.Hj)  > r} 

wh  erf 

< P(Y1  r.Hj)  > r - p(Y|r,H|)  p(r|Hj)  dr  = p(Y|ll|)  . 


L 


object 
has  been 

ave  rage 
With  tne 


(3.1a) 


( 3.  lb  ) 
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The  three  terms  on  the  right  hand  side  (RHS)  of  (3.1a) 
represent  the  costs  associated  with  deciding  the  absence  of 
the  object,  deciding  its  presence  and  estimating  the  object 
boundary,  this  grouping  being  based  on  the  estimator  or 
detector  related  actions.  On  (3.1b)  however,  the  costs  are 
grouped  with  an  input-output  perspective  in  mind;  they 
represent  the  global  costs  associated  with  producing  an 
estimate  (2  costs) , and  with  outputting  decision  \q  (the 
first  two  terms  on  the  RHS) . Assuming  the  set  of  costs  in 
(3.1)  to  pe  positive,  it  can  be  seen  that  minimization  of 
Rj^^^  (with  respect  to  6 and  ) is  equivalent  to 
minimizing  the  integrand  ( 6 - ) , 


R 


d + e 


{£  ,r) 


r ^ d+e 
est 


est 


est 

• P|  V. 

+ '(v,lY)[Po(c,  „tf,  „)P(V|H„) 

• P|  ‘ f‘'l,  I ' '1,  > '■I! 

• P|  ''o.i  P'''l"i" 


' '•■■|l'''fPo'"i.o'  'i.o'  PI''l"o' 

* '”'"r  'P|'('l,l'  ‘l.l'P.-st’''" 

est 

p(Yl  r,  H,)  > r}]  } . ( 3.  2 ) 
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From  (3.2)  it  can  be  seen  that  the  minimization  can  be 


L 


done  in  two  steos.  First  with  resoect  to  r for  anv 

decision  rule,  and  second  with  r reolaced  by  the  ootimal 

est 

estimate,  the  optimal  decision  rule  can  be  derived.  The 
defininq  relations  for  the  ootimal  estimator  and  detector 
are  consequently: 

< £,  , (r  r)  p(Y|  r,  H,  ) > r = min  < f (r  , r ) pi  Y [ r , H ) > r . 

1,1  1 r , 1 , I est  1 

est 

( 3.  3 1 

Decide  the  object  is  present  ( - " ( \ j ] Y)  = 1 , 5 (\q|y)=D) 

when : 


Po'q.o'  S.o'  ‘ f,,,C-\r.lP(V|r.ll,,  > r) 

- Po‘o,o  * P|  ‘o,i  ‘ ’ 


Otherwise,  decide  the  object  is  absent  (6  {'.ylY)  = l, 

6'  (y,  I Y =0)  . 

special  case  of  interest,  in  the  seauel  , is  obtained 
when  the  cost  of  estimation  is  chosen  to  be  the  quadratic 
er  ror  . 


Quadratic  Fr  ror  Cost  : 

. r(JN,|  = (r„,-  ■'I'C',.,-  ■•> 


3h 


The  procedure  indicated  by  (3.3)  becomes. 


< I (r  ' , r)  p(y1  r,  Hj)  > r 

= min^  < - r ) p{ Y | r,  H ^ ) > r 

est 

- min^  j ^^est"  ^''*^est'  P(Ylr,Hj)  p(rlHj)  dr 
est 

= min^  ' ' r)  p(r|  Y,Hj)  p(Y1Hj)  dr 

est 

= p(  Y 1 n ) min  ^(r  -r)'(r  -r)p(rlY,H)dr.  (3.6) 

' 1 r ^ V est  est  ' 1 

est 

In  view  of  tne  last  equality,  it  is  well  known  that  r 
minimizing  (3.6)  corresponds,  in  this  case,  to: 

r''[jNlY(j)]  = E[  r(jN)lY(j)  , H,  ] . ( 3.  7 ) 

Le  1 1 i ng  , 

P 'V  jN|  Y(j)  . H,  ] = P"  = f (r'"- r)(r"- r)'  p(r  I Y,  H ) dr  (3,8) 

I «J  i 

and  replacing  (3.7),  (3.8)  into  (3.4), 


Po<"i,o'  ‘i,o’ 

" Po^o,oP'''l»o'  * P|  ‘^0,1  • 


‘o.l  - "l.l  ’ " 
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which  Denalize  more  heavily  wronq  decisions.  Collectino 
terms  in  (3.9)  and  using  (3.10),  it  follows  that  (see(3.4)) 


- "l.l  “Po''l,o'  'l.O-  'o.o' 

(3.11  ) 


Therefore,  the  optimal  detector  decisioning  becomes: 


6 (Vj|Y)  - 1 


K >0 
c 


3.  I 2a  ) 


5 (VqIY)  = 0 


J.  JN 


( 3.  12b  ) 


6'V'olY)  = 1 


6 (vj  1 Y)  = 0 


K 0 
c 


K > 0 
c 

and 

A < k" 
jJN 


3.  1 3a  ) 


3.  1 3b  ) 


3.  13c  ) 


wnere , 


K = c - c - tr  P 
c 0,1  1,1 


P,  pfY(j)|Hj] 
j.jN  ' P,^  p[Y(j)lH  1 


, j—  l,...,bl 


( 3.  14  ) 
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Fig.  (3.2)  corresponds  to  the  quadratic  error  boundary 
processor  indicated  in  (3.7),  (3.12),  (3.13),  where  the 
interdependence  between  the  detection  and  the  estimation 
stages  has  been  shown  explicitly.  Note  that  the  switch, 
(in  Fig.  (3.1))  operated  by  the  detector  has  been  delayed 
with  respect  to  the  estimator. 

Two  more  cost  functions  and  their  associated  optima 
processors  are  considered  in  Appendix  A.  The  first 
processor  while  useful  for  estimating  hypothesis-dependent 
parameters  (HOP)  involves  a detector  with  different  costs 
for  non-detection.  In  particular,  the  penalty  incurred 
when  missing  big  objects  is  greater  that  the  one  charged 
for  small  objects.  Although  the  resulting  estimator  is 
identical  to  (3.7),  the  detector  threshold  now  depends  on 
the  parameter  estimate  and  covariance  instead  of  the 
covariance  only.  Energy-type  parameter  (ETP)  estimation  is 
provided  by  the  second  processor.  A clear  difference  of 
this  processor  from  the  previous  ones  is  that  it  always 
produces  an  estimate  at  its  output;  furthermore,  the 
estimator  found  no  longer  performs  estimation  under 
certainty  of  observation  but  besides,  involves  the 
evaluation  of  a fraction  with  values  between  zero  and  one. 
The  detector  threshold  is  a function  of  the  estimate 
obtained  without  uncertainty. 


It  is  important  to  comoare  the  cost  functions 

resulting  in  ( 3 . 7 ) , ( 3 . 1 2 ) , (3.13)  with  the  costs  (A. 3)  in 

order  to  understar. d the  basic  differences  involved  in 

estimating  these  two  oarameter  classes.  Note  that  in  ETP 

estimation  each  decision  has  an  associated  estimate*,  in 

this  particular  case  (case  2 of  appendix  A),  when  is 

decided,  said  value  is  zero,  while  r is  associated  with 

est 

Vj  • Qn  the  contrary,  no  estimate  can  prooerly  be 

associated  to  decision  in  HOP  estimation.  Note  also 

that  with  ETPs,  the  set  of  parameters  under  E(  ^ corresponds 

to  )r=0},  but  that  no  such  representation  exists  for  HDPs. 

These  idiosyncrasies  are  manifested  on  the  second  and  third 

costs;  these  are  the  costs  incurred  when  deciding 

erroneously.  The  estimation  penalty  on  the  second  line  in 

2 

(A. 8)  depends  on  r . however,  as  the  true  value  of  the 

est 

parameter  is  r=0,  this  penalty  indeed  is  a function  of  the 

squared  af  the  estimation  error.  For  the  HOP  case,  the 

estimation  cost  is  independent  of  the  estimate  provided; 

this  serves  to  penalize  the  action  of  false  alarming 

regardless  of  any  geometric  considerations  of  the  estimated 

object.  In  fact,  as  there  is  no  object  (Hq ) , anv  estimate 

is  equally  undesirable.  The  third  estimation  cost  in  (A. 8) 

2 

penalizes  as  a function  of  r , However,  as  the  output 
estimate  is  zero,  such  cost  then  depends  on  the  sauarcd  of 
the  estimation  error.  In  HOP  estimation,  the  cost  c ^ is 
constant.  Such  a cost  is  necessarv  to  ensure  that  any 
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Y(j) 
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Fig.  3.2.  Quadratic  error  boundary  processor 


any  object  misf;ed  is  oenal  ized  identically. 

It  must  be  oointed  out,  uoon  reflection  on  the  costs 
used,  that  the  joint  est  ima  t ion-decect  ion  considere-J  before 
has  been  treated  in  isolation  from  other  lines.  In  fact, 
more  general  situations  involving  the  joint  scheme  could  be 
obtained  by  a set  of  costs  that  not  only  weighs  the  results 
of  decisions  in  the  present  line  but  of  future  ones  as 
well. 

It  is  necessary  to  turn  our  attention  to  the 
implementation  of  (3.7)  as  well  as  (3.14).  Although  the 
optimum  detector  is  defined  in  terms  of  (3.12),  (3.13),  it 
is  clear  that  the  successful  evaluation  of  the  likelihood 
ratio  (3.14)  is  of  paramount  imoortance  to  be  able  to  use 
the  former  two  relations.  The  next  two  sections  will  be 
dedicated  to  the  implementation  of  the  components  appearing 
in  F iq  . (3.2). 


■ 


The  Estimator 


This  section  is  concerned  with  the  choice  of  a general 
estimation  procedure  having  desirable  computational 
properties  while  being  applicable  to  the  problem  at  hand. 
Let  the  n-d imens ional  vector  x(k)  be  defined  by 


( 3 . 1 S 


X (k)  r [ r(k) 


zlk)'  ] 


42 


wnere  r(k)  is  tne  object  vector  [w(k)  c(k)]'  and  z(k) 

represents  the  random  processes  associated  with  the  object 

and  background  textural  information,  s (k)  and  s,(k).  The 

o b 

latter  quantities  can,  in  general,  be  modeled  by  first 
order  Markov  processes  [29,31,32].  This  along  with  (2.13) 
results  in  a linear  model  for  x(k)  , 

x(k)  = A(k)  x(k)  + B(k)  u(k)  ( 3.  16  ) 

with  u(k)  being  a zero  mean  white  normal  sequence  with 
identity  covariance  matrix.  The  observation  given  by  (2.7) 
is  highly  nonlinear  due  to  the  structure  of  (2.7)  and  the 
binary  nature  of  X(k)  given  by  (2.9). 

From  the  computational  point  of  view,  considering  that 

tne  amount  of  data  is  generally  very  large  (a  typical  image 

2 

IS  decomposed  into  (256)  pixels  or  more)  it  is  desired 
that;  (a)  the  estimator  be  of  recursive  nature  and  (b)  the 
information  transferred  to  any  step  of  recursion  from  the 
previous  step  be  of  limited  nature  (e.g.,  first  and  second 
order  moments  only).  The  latter  requirement  is  important 
because  recursivity  alone  does  not  necessarily  reduce  the 
computational  burden.  In  fact,  a very  general  recursive 
procedure  for  determination  of  the  a posteriori  probability 
density  is  available  [33]  , albeit  completely  impractical. 
The  extended  Kalman  filter  and  its  variations  are  a set  of 
filters  that  meet  both  those  requirements  [34-36]. 
However,  these  estimators  require  linearization  of  the 


L 
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system,  includinq  the  observation  equation,  at  each 
recursion  step.  This  is  not  possible  here  due  to  the  typo 
of  nonlinearity  involved,  in  particular,  the  binary  nature 
of  >.(k)  as  expressed  by  (2.9). 

To  be  more  specific,  let  us  define  the  estimate  of 
x(k-l)  and  its  covariance  at  time  k-1  (i.e.,  after  y(k-l) 
has  been  received)  by  x(k-l|  k-1)  and  P{k-ll  k-1) 
r aspect ive 1 y. 


Considering  a restriction  on  information  transfer, 
first  and  second  order  statistics  only,  the  information 
available  to  obtain  the  estimate  of  x(k)  at  time  k is 
x(k-llk-l),  P(k-ljk-l)  and  y(k).  From  (3.16),  this  leads 
to  a predicted  estimate  and  a covariance  of  x(k)  (before 
y ( k ) is  received)  : 


x(klk-l)  - E[x(k)lx(k  - 1 ]k  - 1),  P(k-llk-l),  y(k-D] 

= A(k  - 1 ) E[x(k  - l)lx(k  - 1 jk  - 1),  P(k  - 1 Ik  - 1),  y(k  - D] 
f B(k  - 1)  E[u(k  - l)lx(k  - 1 Ik  - 1),  P(k  - 1 Ik  - 1),  y(k  - D] 

- A(k  - 1)  x(k  - l|k  - 1)  . ( 3.  17  ) 


Simi lar 1 y, 

P(k  I k - 1 ) = Ej  [x(k)  - x(k  j k - 1 ) ] [x(k)  - x(k | k - 1 ) ] ] x(k  - 1 (k  - 1 ), 

P(k  - 1 |k  - 1),  y(k  - I)]] 

^ A(k  - 1)  Elfx(k  - 1 ) - x(k  - 1 jk  - l)lfx(k  - 1)  - x(k  - 1 Ik  - 1))'| 
x(k  - 1 Ik  - 1),  P(k  - 1 Ik  - 1),  y(k  - 1)}  A'(k  - 1) 
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4 B(k  - 1)  B'(k  - 1) 

A(k  - 1 ) P(k  - 1 ]k  - 1 ) A'(k  - 1 ) + B(k-  1 ) B (k  - 1 ) . ( 3.  18  ) 

Equations  (3.17)  and  (3.18)  express  x(k|k-l)  and 
P(k|k-1)  in  terms  of  x(k-llk-l)  and  P(k-llk-l). 

Consequent! Yf  the  MMS  estimate  of  x(k)  and  its 
covariance  given  the  above  information  are  given  by 

= E[x(k)lx(klk-1),  P(klk-l),  y(k)]  ( 3.19  ) 

PmMs'“I*'>  = E[.(k)-X^^g(klk)|[.(k)-X_^^3(k|k)|i5(k!k-1), 

P(klk-l),  v(k)]  . ( 3.  20  ) 

By  direct  application  of  Bayes  rule, 

p fx(k)  I x(k|  k- 1 ),  P(klk'l),  y(k)] 

p[x(k),  y(k)|x(k|k-l),  P(k|k-1)]  _ { 3 21  ) 

’’pfx(k),  y(k)lx(k|k-l),  P(kjk  - 1)]  dx(k) 

Since  v(k)  is  an  independent  white  noise, 

p[x(k),  y(k)lx(klk-l),  P(klk-l)] 

= pfy(k)lx(k)]  p [x(k)  1 x(kl  k- 1 ),  P(k|k-1)]  . ( 3.  22  ) 

The  probability  density  function  p[x(k)lx(klk-l), 

P(k|k-l)l  appearing  in  (3.22)  represents  the  knowledge  on 

x(k)  a priori  to  the  reception  of  y(k) . Determination  of 

the  exact  form  of  this  probability  density  is  very 
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complicated  and,  in  fact,  requires  transfer  of  information 
beyond  the  first  and  second  order  moments.  Consequently,  a 
density  function  will  be  'assigned"  to  this  and  denoted  by 
p^[x(k)l  satisfying  the  two  given  moments  exactly.  The 
assignment  of  this  function,  in  liaht  of  comoutat lona 1 
considerations,  is  an  aopr ox ima t ion  resulting  in  the 
estimate  x(k|k)  and  its  covariance  P(klk)  (this 

approximation  is  in  lieu  of  the  linearization  in  t.he 
extended  Kalman  filter,  which  is  not  applicable  here). 

Explicit  relations  for  .x(kjk)  and  P(k|k)  are  thus  obtained 

by  making  the  indicated  change  in  ( 3 . 2 2 ) , ( 1 . 2 1 ) and  further 

replacing  into  (3.19)  and  (3.20), 

^x(k)  p[y(k)lx(k)]  p [x(k)]  dx(k) 

x(klk)  = (3.23) 

' P[y(k)lx(k)]  p [x(k))  dx(k) 

t cL 

*'[x(k)  - x(klk)]fx(k)  - x(k|k)]  p[y(k)lx(k)]  p [x(k)]  dx(k)  . 

P(klk)  = ^ 

p[y(k)|x(k)]  p [x(k)]  dx(k) 

( 3.  24  ) 

Equations  (3  23)  and  (3.24)  along  with  (3.17)  and 
(3.18)  constitute  the  desired  recursive  estimator.  The 
specific  choice  for  Pa(')>  3S  well  as  its  effect  on  the 
computational  burden  and  performance  of  the  estimator  will 
be  postponed  until  chapter  four  where  two  special  cases  of 
boundary  estimation  will  be  considered. 
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The  Detector 


i 


An  alqorithm  applicable  to  the  evaluation  of  the 
likelihood  ratio  is  deterinined  in  this  section.  Recall, 
the  likelihood  ratio  (LR)  was  defined  in  (3.14)  as: 

P,  p[Y(j)lHj] 

iN  = j " * ^ 

PoP[Y(j)lHQ] 

Pj  Pfy(jN),  y(jN-l),  ....  y((j-l)N+  1 I H ] 

(3.25) 

Pq  P[y(jN),  y(jN-l),  ....  y((j-l)N+ 1 [Hq] 

The  direct  evaluation  of  (3.25)  is  a formidable  task, 
in  most  cases,  due  to  the  dimensionality  of  the  densities 
involved,  and  furthermore  by  the  fact  that  each  observation 
y(k),  k= ( j -1 ) N+1 , . . . , jN  is  random  not  only  because  of  the 
additive  noise  v(k) , but  also  because  the  siqnal  s(k)  is 
random  as  v/ell. 

However,  for  a related  problem,  dealinq  with  the 
detection  of  a known  siqnal  s(k)  in  white  Gaussian  noise, 
the  evaluation  of  the  LR  is  particularlv  simple  [37]  . It 
involves  a 'correlator"  of  the  observation  y(k)  v^ith  the 
signal  s(k),  i.e.,  it  requires  the  computation  of 

Z^y(k)s(k).  Moreover,  when  detecting  Gaussian  signals 

s(k)  in  additive  white  Gaussian  noise  [38],  the  evaluation 
of  tne  LR  also  involves  a "correlator,"  in  this  case, 
connecting  the  MMS  estimate  of  the  siqnal  and  the 
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observation  y{k).  The  riMS  estimator  olays  a recurrent  role 
under  more  general  conditions  o£  detection  as  is  evidenced 
in  [39-411.  Kailaths  (39)  expressions  for  the  LR  in  terms 
of  the  casual  MMS  estimator,  and  vice  versa,  unfortunatel v 
are  defined  in  the  Ito  Calculus  sense,  and  are  applicable 
to  continuous  time  problems.  In  the  discrete  case,  even 
though  relations  resembling  the  ones  for  the  continuous 
case  exist  (tnat  express  the  LR  as  a function  of  the  casual 
MMS  estimator,  and  vice  versa),  their  applicability  is  very 
restricted  [42-46].  In  summary,  the  difficulties 
associated  with  the  direct  evaluation  of  the  LR  have  been 
pointed  out.  Furthermore,  the  close  relation,  in  the 
context  of  detection,  between  mmS  estimation  and  the  LR  has 
been  indicated. 

It  is  possible  however,  to  view  the  LR  in  terms  of  a 
recursive  expression.  Let  us  define,  in  general  for  anv  k, 

/\  , b y; 

J.  k 

p p[y(k),  y(k-l),  ...,  y([j  - 1 )N+ 1 ) ) H ) 

A.  = — — (3.26) 

Pq  p[y(k),  y(k-l),  ....  y((j-l)Nf  1)1  Hq] 

j = 1 ,N  , [j-1)  Nfl  ^ k 5 jN  . 

Raving  defined  , as  above,  usino  the  definition  of 

J.  k 

conditional  density,  the  fact  that  the  additive  noise  v(k) 
is  white,  by  application  of  Bayes  rule  and  similarly  to  the 
procedure  leading  to  (3.21),  (3.22),  it  follows  that 

4K 


where  the  density  p [ y { k ) | z ( k ) , ] has  been  exolicitlv 
expressed  in  terms  of  z(k)  and  not  x(k)  because  under  the 
hypothesis  the  object  boundary  is  undefined. 

Finally,  taking  logarithms  in  (3.27a) 

In  A.  ^ = In  ) r p[y(k)|x(k)  , H J p[x(k)ly(k-l  ),  . . . ,H  J dx(k) 

j ''  P[y(k)|  z(k)  , Hq]  p[z(k)|y(k-l),  . . . ,Hq]  dz(k)} 

.lnA.^k-1 


j = 1 N , (j-l)N+l  ^ k i JN  . 

Comparison  of  (3.26)  and  (3.25)  indicates  that  the  I,R 
is  equal  to  Aj  ^ k = jN.  Also,  as  (3.28)  has  been 

derived  from  (3.26),  the  former  relation  represents  a 
recursive  alternative  to  (3.25)  in  the  evaluation  of  the 
LR. 

The  probability  density  o[x(k)|  y(k-l),...,  H|]  in 

(3.20)  plays  a central  role  in  the  MMS  estimation  of  x(k) 

given  the  past  observations  y(k-l),...,  Mj,  because  it 

4 0 


agglutinates  the  knowledge  on  x(k)  a priori  to  the 

reception  of  v(k),  and  also  because  the  first  two  moments 

of  the  density  correspond  to  the  MMS  estimate  and  error 

covariance.  However,  it  was  indicated  in  the  previous 

section,  that  as  a result  of  constraints  imposed  on  the 

estimation  algorithm  the  available  ( forwarded  ) 

information  on  x(k)  prior  to  the  reception  of  y(k) 

consisted  of  x(klk-l)  and  P(klk-l).  Besides,  the  exact 

evaluation  of  o[x(k)|  y(k-l),...,H^],  in  most  cases,  was 

discarded  as  impractical.  It  is  therefore  necessary  to 

resort  to  an  approximation  of  the  ^ priori  density  function 

(for  an  application  when  the  approximating  density  is 

gaussian,  see  (47) ).  In  the  following,  the  conditioning 

variables  in  the  prior  density  are  replaced  by  the 

available  statistics,  and  subsequently  the  procedure 

indicated  in  the  estimator  section  is  applied.  The  result 

is  a recursive  expression  for  L . an  approximation  to 

.1.  k 

In  ) '' p[y(k)  1 x(k)  , H j fx(k)  I n j I dx(k) 
j ^ Pfy(k)|z(k)  , p^[z(k)lHy|  dz(k)} 


A . 


j.k  ' 


In  L.  , 
J.  k 


f In  L. 

J.  k-  1 

j = 1,...,N 


(j-1  )N4  1 r.  k <:  jN 


( 3. 2Pa  ) 


S.  (j-l)N 


Pi  ' Pr 


( 1.  d'H)  ) 


SO 


It  is  convenient  to  point  out  reqarding  the  evaluation 
of  the  likelihood  ratio  by  the  algorithm  (3.29a),  that  the 
denominator  in  (3.23)  and  the  numerator  expression  in 
(3.29a)  are  identical.  The  explicit  appearance  of  Hj  in 
the  latter  one  serves  to  stress  the  hypothesis,  a datum 
that  was  unnecessary  in  the  context  of  the  preceding 
section.  In  later  applications  this  fact  is  used  to  reduce 
the  amount  of  computations  required  to  evaluate  the  LR. 
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CHAPTER  FOUR 


Boundary  Est imat ion  for  Binary  Pictures 


Binary  images  are  those  where  the  object  and 

background  luminance  levels  are  constants,  i.e., 

s (k)  = s ; s,  (1^)  = s . 

o o b b 

Two  cases  are  considered  here:  one  where  s and  s,  are 

o b 

known  ( hence  only  w(k)  and  c(k)  remain  to  be  estimatf^d  ), 

the  other  when  s and  s,  are  also  unknown, 
o b 


For  the  case  of  known  luminances  (x(k)=r(k)), 


exp  - 


O 


p[y(k)lx(k)l 


exp  - 


Ztt  0 


[y(k)  - s 


lo 


fy(k) 


for  X(k)  - 1 


( 4.  1 ) 


for  /■  (k)  - 0 


where  it  is  necessary  to  determine  regions  of  the  w and  c 
plane  where  X (k)  is  zero  or  unity.  These  areas  are 

illustrated  in  Fig.  (4.1)  and  result  from  (2.1fl).  Hence 
(3.23)  and  (3.24)  become 

x(k|k)  = x(k)  p fx(k)]dx(k) 

■^  = 1 


1 


I 


I 
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-[y(k)  - 

f e x(k)  p^fx(k)  dx(k)] 

-[y(k)-s  )‘^/2o^ 

/ je  h-i  P [x(k)]  dx{k) 

-[y(k)  - . 

f e 1>  =0  Pa  ( -i.  d ) 


-[y(k)  - s ]^/ 2a^  , 

P(klk)  = je  ° I l[x(k)  - x(k|k)][x(k)  - x(k|k)]' 

A A 

-[y(k)-sj‘^/2a^  ,, 

p^fx(k))  dx(k)}  + e jfx(k)  - i(k|k)] 


[x(k)  - x(k|k)]  p [x(k)]  dx(k)}  } 

a 

-[y{k)  - s^]^/2o^ 

/ i e p^[x(k))  dx(k) 

-[y(k)  - s^]^/2a^ 

(-  e U _n  P=.  'Px(k)}  . ( 4,  3 ) 

«J  A — U a. 


When  the  background  luminance  is  assumed  known,  the 
denominator  in  (3.29a)  reduces  to: 


1 fy(i^)-Sj^r 

pfy(k)|  z(k)  , HqI  P^  [z(k)lH^]  dz(k)  = j-  exp  - 


( 4.4  ) 


Consequently,  the  detector  relationship  to  be  evaluated 
necome  s : 
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In  L.  , = In  L , + 

J.k  J,k-1 


[y(k)  - s 


2 a 


-[y(k)  - s ]^/2o^ 

In  |e  p^[x(k)]  dx(k) 


-[y(k)  - s ]^/2o^ 


{ 4.  5 ) 


Let  us  now  consider  the  case  of  unknown  luminances, 
and  further,  assume  that  the  probability  density  p^[x(k)] 
can  be  represented  by: 

p^[x(k)]  = P^[r(k)]  p^[z^(k)]  p^[z^(k)]  (4.6) 

where  z (k)  and  z,(k)  correspond  to  the  states,  in  the 
o b 

model  (3  16),  associated  with  the  representation  of  the 

object  and  the  backqround  textures.  For  instance,  if 

and  s^  are  a priori  (assumed)  values  for  both  textures, 

then  z , z represent  the  deviation  from  such  values  and 
o b 

they  are  sought  during  the  estimation,  in  other  words: 


z (k)  = s 
o o 


( 4.  7 


In  order  to  simplify  the  expressions  for  x(k|k)  and 
P(k| k) , let  us  first  consider  the  denominator  on  (3.23), 
(3.24) 


(l)For  readibility,  the  argument  (k)  has  been  dropped 
except  in  the  last  relation. 
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DEN  = ^'^^p(ylx)  p (r)  p (z  ) p (z  ) dr  dz  dz 

cv'v  3*  303b  OD 

^ *!x.l  Pa<"b' 

" !x=0  Pa<">  Pa^^>  Pa<"b’^ 

= !!  *Pa<%^  Pa‘"o>  ,'x=l  Pa^’^* 

* Pa^'o’  Pa<^3>  !x  = 0 Pa<"'^  '^^b 

= i!  *Pa<"b>  Pa<"o>  P<^l"o’  !x=l  Pa'"> 

^ Pa^"o>  Pa<"b^  P<y|"b>  !x  = 0 Pa'"'^  ^"b 

^ ^ Paf^b*^^'  P[y(k)lz^(k)]  p^[z^(k)l  dz^(k)] 

fjX(k)=l  Pat^^l^Hdrik)]]  + ijpjz^(k)dzjk)] 

['  pfy(k)lz^(k)l  P^[Zj^(k)]  dr(k)]} 

( 4,  8 ) 

where  p[y(k)|z  (k))  and  p[Y(k)lz  (k)]  show  the  explicit 
o ' b 

dependence  of  p[y(k)  x(k)]  in  the  regions  where  the  object 
or  the  background  is  present,  i.e.,  these  densities 

represent  the  counterpart  to  (4.1)  for  the  case  of  unknown 
lumi nance . 
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■ 


The  calculation  of  (3.23)  by  the  same  procedure  used 


to  obtain  (4  8)  results  in: 


[^(0  z 0 ) p[y(k)jz  (k)]  p [z  (k)]  dz  (k)] 
o 'o  a o o 

Cx(k,=  l Pj'-ikll  ■ir(k)l) 

+ |[f(0  k 0)  p [z  (k)]  dz  (k|) 

C a KJ  O 

[|(0  0 z^)  p[y(k)l  Zj^(k)]  p^[z^(k)]  dZj^(k)] 

fjMk)  = 0 dr(k)]}}  / DEN  . 

( 4.  9 ) 

In  a similar  fashion  (3.24)  can  be  evaluated.  For 
simplicity,  only  the  term  [ r ( k ) -r  ( k j k)  ] [ r ( k ) -r  ( k 1 k)  ] ' is 
presented  in  the  following.  Other  terms  like 

[z.(k)-z.(kl  k)j  (z.(k)-z.(klk)]  ' ,i=o,b  can  be  obtained  bv 
replacing  the  former  expression  on  the  left  hand  side  by 
the  latter  ones  and  performing  the  appropriate  groupings  on 
the  RHS: 


i jfr(k)  - r(klk)]fr(k)  - f(klk)]'  pfy(k)lx(k)]  p [x(k)]l  dx(k)  / DEN 

a 

* * pfy(l<)|  Z^(k)]  p^[z^(k)]  dz^(k)] 
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[i,  , [r(k)  - r(k|k)][r(k)  - r(klk)]  [r(k)  dr(k)]} 

^ix(k)  = 0 P^[r(k)]  dr(k)]}}  / DEN  . 

( 4. 10  ) 

It  is  important  to  comment,  at  this  point,  on  the 

preceding  set  of  relations.  First  of  all  in  (4.2),  (4.3) 

the  final  evaluation  is  ultimately  dependent  on  the 

orobability  density  d [x(k)]=p  ir(k)]  and  furthermore,  on 

■ a a 

now  the  two  integrations  are  oerformed.  Secondly,  the 

particular  form  (4.6)  is  necessary  to  arrive  at  the  simple 

relations  ( 4 . 8 ) - ( 4 . 1 0 ) , where  p [r(K)l  or  more  specifically 

a 

tne  integrations  over  the  X =0  and  X =1  regions  present  the 
same  characteristics  cited  above. 

The  detector  relation  (3.29a)  becomes,  in  this  case: 

In  = In  - In  i [y(k)  1 z^(k)  , | [z^^(k)  1 | dz^^(k)  ] 

t-  In  DEN 

= In  L - In  j ' p[y(k)l  z (k)]  p fz  (k)]  dz  (k) 

j , k - 1 ti  u a o o 

I-  In  DEN  , ( 4.  1 1 ) 

Note  tnat  in  order  to  perform  detection  bv  the 

procedure  outlined,  it  is  only  necessary  to  accumulate  two 

by-products  of  the  estimation  stage,  avoiding  this  way  any 
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need  for  any  new  calculations. 


Next,  we  return  to  the  choice  of  the  probability 
density  function  p [x(k)J  such  that  its  first  two  moments 

cL 

be  equal  to  x{k|k-l)  and  P{k|k-1)  respectively.  From  an 

information  point  of  view  [151,  for  a qiven  mean  and 

variance,  the  normal  distribution  represents  the  maximum 

uncertainty  (entropy);  consequently  a Gaussian  density 

would  be  a conservative  choice.  However,  this  directly  « 

violates  the  precise  ^ pr ior i knowledqe  that  the  random  ^ 

t 

variables  w(k)  and  c(k)  as  well  as  z (k)  and  z. (k)  are  < 

o b 

bounded  in  magnitude  ( the  first  ones  represent  the  center 

and  width  of  the  object  on  a given  image  while  the  latter 

ones  are  the  luminance  values  of  the  texture,  constrained  i 

by  the  imaging  system  ).  A choice  that  satisfies  this 

requirement  and  completely  avoids  the  necessity  of  any 

numerical  integrations,  is  to  select  independent  uniform 

densities  for  w(k)  and  c(k)  ( and  z , z for  the  case  of 

o b 

unknown  luminance  ).  Fig.  (4.2)  shows  a typical  region  of 
integration  when  uniform  densities  are  used. 

It  was  stated  above  that  as  a result  of  the  choice  of  i 

: 

a uniform  density  for  p^[x(k)],  no  integrations  were 
necessary.  This  fact  in  view  of  the  comments  on  equations  -i 

(4.2)-(410)  was  one  of  tne  attributes  sought  from  the 
approximating  density.  a 
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Let  us  consider  in  the  followinq,  the  steps  necessary 

to  carry  out  the  above  i nteqr at i ons . Althouqh  Fiq.  (4.2) 

I 

i represents  a typical  case  ( to  be  explained  later  ) , 

I without  much  thouqht  one  can  see  that  there  is  no  reason  to 

believe  the  region  where  o [r(k)]  is  different  from  zero 

a 

[ should  lie  completely  inside  the  trianqular  area  defined  by 

: (2.10)  in  the  w,  c plane  ( albeit  r(k|k-l)  does).  In  fact, 

; Fiq.  (4.3)  presents  an  enumeration  of  the  possible 

I interceptions.  Two  possible  alternatives  result  ’ from  the 

j last  figure:  first,  it  is  possible  to  disregard  (2.10) 

t 

i entirely  and  proceed  to  integrate  over  the  corresponding 

I original  rectangular  region  (where  p [r(k)l  i 0).  Second, 

i , ^ 

' the  validity  of  the  density  function  can  be  restricted  to 

the  interception,  but  then  a new  density  has  to  be  found. 
In  this  dissertation  the  second  alternative  has  been  taken, 
where  the  new  density  has  been  assumed  uniform  and 
different  from  zero  in  the  intercepting  region  of  the  w,  c 
plane.  It  must  be  pointed  out  that  an  error  is  likely  to 
oe  introduced  by  either  alternative,  except,  in  the  case 
shown  in  Fig.  (4.2)  where  both  approaches  coincide  and  no 
error  is  generated.  When  (2.10)  is  not  accounted  for,  this 
error  refers  to  contributions  to  the  integrals  from  w,c 
pairs  in  □ (symbol  definition  below)  but  outside  A . When 
the  density  is  modified  to  account  for  (2.10),  the  error 
refers  to  the  difference  in  moments  of  the  modified  and 
original  density  defining  o . 
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In  other  words,  i£ 


denotes  interception,  and  if: 


a = i(w(k)  , c(k)  : p fr(k)|  0} 

cL 

A = i(w(k)  , c(k)  : w(k)  2 0 , ^ ^ ^ ^ ] 


then,  it  is  necessary  to  perform  tne  following  integrations 
(see  (4  2.),  (4.3)  , (4.3)-(4.10)  ) : 


dr(k) 


dr  (k) 


(X^O)  0 (DP  A) 

I r(k)  dr(k) 

(X  = 0)  ^ (DPA) 

I r (k)  r(k) dr (k) 

(X  = 0)  P (DP  A) 


(X=l)  P (□'^  A) 

^ r(k)  dr (k)  (4.12) 

(X  = i)  n (dp  A) 

^ r'(k)  r(k) dr(k)  . 

(X=l)  P (DP  A) 


Because  of  the  variety  of  shapes  the  regions 
(X  =0)"'(OPA)  and  ( X=l)'^,  (OPA)  can  take,  the  integrations 
(4.12)  have  been  carried  out  analytically  on  the  set  shown 
in  Fig.  (4.4).  Each  region  in  (4.12)  can  be  viewed  as  a 
mosaic  of  the  latter  simpler  polygonal  areas  (see 
Fig.  (4.5)  for  an  example).  This  in  turn,  reduces  the 
integration  to  a search  for  a mosaic  and  a simple  numerical 
evaluation. 

Although  there  are  16  different  interceot ions  drawn  in 
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Fiq.  (4.3),  experimental  results  indicate  that  freouently 
only  four  cases  (1-4 , 1-5, 1-6 , 1-7)  occur,  with  the  case 
depicted  in  Fiq.  (4.2)  beinq  the  most  frequent. 


i 


Experiment^  Procedures 


The  purpose 

of 

the  foregoing 

chapters 

has  been 

the 

mot  iva  t ion 

on 

the 

subject  of 

boundary 

estimation 

, the 

de  r i va  t ion 

of  an 

optimal  boundary 

processor 

mini.mizinq 

t he 

average 

costs 

of 

joint  detection-estimation  in 

no  isy 

imaqery  and  the  subsequent  recursive  implementation  of  a 
suboptimal  processor,  based  on  first  and  second  order 
moments . 

This  section  deals  with  the  application  of  the 
boundary  processor  to  a set  of  imaqes  and  the  presentation 
of  these  results  as  visual  evidence  to  its  capabilities. 


In  chanter  two,  it  was  shown  that  the  replacement 
function  was  expressible  in  terms  of  neometric 
characteristics  of  the  objects,  these  qeometric  properties 
beinq  the  width  and  center.  In  consequence,  modeling  the 
binary  function  implied  testing  as  to  the  foreground 
presence  olus  a model  for  the  geometry  itself.  In  the 
modeling  of  the  qeometric  characteristics,  the  continuous 
counterparts  of  the  width  and  center  wem  assumed  expressed 

h A 


1 


in  terms  of  a first  order  Markov  sequence.  Hence,  to  be 
able  to  apply  the  processor  relations,  the  first  step 
necessarily  must  be  the  determination  of  the  matrices 
appearing  in  (3.16),  which  in  turn  are  defined  by  the  class 
of  objects  under  investigation. 


In  the  following  the  boundary  processor  will  be 
applied  to  a set  of  256X256  binary  images  containing  an 
ellipse.  An  elliptical  form  has  been  chosen  because  bv 
changing  five  parameters,  different  orientation,  location 
and  size  objects  can  be  readily  obtained.  Besides, 
ellipses  are  examples  of  horizontally  convex  objects. 


To  illustrate  the  procedure  followed  in  determining 
the  matrices  in  (2.14),  let  us  assume  for  simplicity  that 
only  one  ellipse  of  fixed  orientation,  size  and  position 
needs  to  be  estimated.  This  assumption  seems  quite 
restrictive  because  in  general  more  than  one  ellipse  may 
need  to  be  detected.  Later  on  it  will  be  dropped. 
Nevertheless,  the  procedure  could  be  considered  as  a way 
to  tune"  the  processor.  Let  us  further  assume  that, 


wr(j+l)Nl  = a wFjNl  + b u (jN) 
I ' ' ' vv  I ' w w ■ 


( 4.  1 3 ) 


i.e..  the  Markov  model  is  stationary  and  decoupled  (another 


relation  similar  to  (4.13)  governs  c"  ) . The  former 
supposition  greatly  reduces  the  number  of  parameters  to  be 
determined  while  at  the  same  time  allows  varying  degrees  of 


boundary  smoothness  or  ruqgedness  to  be  accomodated  through 
the  choice  of  a^,  b^.  Decouolinq  is  a resonable  assumotion 
that  otherwise  would  be  indicative  of  geometrical 
dependences  within  the  image  between  widths  and  object 
1 ocations . 

But  from  (4.13), 


E I w [{j  + 1 ) N]  w(JN)}  = a E 1 w (JN)}  + b E jw  (JN)  u (JN)} 


= Eiw  (JN)} 


( 4. 14  ) 


similarly. 


E 1 w [(j  f £)  N]  w(jN)]  = E{w^(jN)} 


( 4,  1 5 


also  from  (4.13)  and  (4.14), 


E|w  [(j+l)N)}  = a E |wf(jf  1)N]  w(jN)l 


+ b E iwf(i+  1)N]  u (JN)] 

W W 

= a“^  E iw^(JN)}  f b^ 
w w 


( 4. 16  ) 


therefore , 


E j w"  (jN)}  f 1 - ] = b^ 

w w 


( 4. 17  ) 


Determination  of  a commences  with  eouation  (4.15). 

w 

In  the  absence  of  en.semble  averaaes,  sample  statistics  have 


been  used  instead.  Further  . a^^  has  been  chosen  to  minimize 

a function  of  the  samole  averages.  'lore  explicitly,  if  the 
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object  is  J lines  "lonq,"  S and  S'  correspond  toS';^ 

J-l  (1) 

S respectively,  then 


and 


I 

[ w(j  + £)  - w ] [ w(j)  - w ] 

® s 

' _ Z — ' 

= , w(J  + £)w(j)  + (J-i)w^  - S[w(j  + £)  fw(j)] 

= (J  - £)  ( 4.  18  ) 

w s ' ' 

s 


where 


w(j)  / J 

Vg  = s [w(j)  - ]^  / J , 


(4.18)  can  be  considered  the  defining  relation 
Thus 


for 


£ I 2 

a = i S w(j  + £)w(j)  + (J  - £)  w 
w s 

s 

- w [-w{  l)-..,-w(X)-w(J)-...-w(J--£-f-l)-l-ZJw  1} 

s s 

I (J  - i)  , ( 4.  19  ) 

s 


The  expression  on  the  RHS  of  (4.19)  is  a function  of 

1,  g(l).  Now,  a has  been  chosen  to  be  the  value  of  a that 
w 

minimizes  for  known  n and  L 


(1)  For  simplicity,  the  index  has  been  shortened  to  j, 
e .g. , w( j ) =w( jN) . 
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Carrying  out  the  minimization  (a^0)f  it  follows  that 


a = exp 
w 


E 


L 


,(l-n) 


In 


(4.21, 


£=1 


In  particular,  for  n=0, 

L. 


a = exp 
w 


y; 


I In  g{IL)  / [ L(L  + 1)  (2L  + 1)]]  . 


4.  22  ) 


Equation  (A  .22)  for  L=10  has  been  used  to  determine  a . b 

w w 
2 

follows  from  (4.17)  through  use  of  the  sample  variance  V , 

s 


2 2 2 

b = ( 1 - a ) V ( 4.  23  ) 

W W S ■ 


Values  of  a^in  (4.21)  for  n=l,2  were  very  close  to 
the  ones  obtained  from  (4.22)  and  were  not  considered 


fur  ther  . 


The  previous  method  and  comments  apply  to  the  center 
parameters  as  well,  when  the  application  involves  several 


objects  or 

more  than  one  object  size,  orientation 

or 

location , 

by 

the  procedure  detailed 

before  a set 

of 

par ame  ter  s 

has 

been  obtained,  which 

in  turn  has 

been 

i averaged  to  produce  the  final  parameter  values. 

I 

To  generate  the  observations,  the  original  set  of 
! pictures,  containing  an  ellipse  with  random  location, 

: orientation  and  size  and  unit  luminance  on  a background  of 

zero  luminance,  was  corrupted  by  additive  white  Gaussian 


L. 
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noise  of  varianceo  . Figs.  (4.6a,b),  (4.7a,b)  illustrate 
some  of  the  observations.  Luminance  values  exceeding  one 
have  been  displayed  as  1 and  those  below  zero  as  0. 

Two  different  boundary  processors  have  been 
impl erne  nted . 

Case  1:  To  single  out  the  boundary  estimation  per  se , the 
processor  was  orovided  with  the  luminance  values  of  the 
object  and  oackground.  Hence,  a 2-state  estimator 
(x  (k) =r  (k) ) was  used. 

Several  detection  costs  were  utilized  throughout  the 
experiments  and  they  have  been  appended  to  the  resulting 
pictures  as  three  numbers  separated  by  commas.  They 
represent,  from  left  to  right:  (1)  if  this  number  (call  it 

K)  is  different  from  0,  a constant  threshold,  K =K,  has 
been  used.  In  this  case,  the  two  numbers  on  the  right  are 
meaningless.  This  constant  value  in  contrast  to  a 
threshold  dependent  on  the  covariance  of  the  estimate  has 
been  used  at  low  noise  levels  because  both  produce 
identical  results.  When  K=0 , a variable  threshold  has  been 
used  as  the  numbers  on  the  right  indicate.  (2)  This  number 
is  equivalent  to  c^  ^ -c^  ^ . (3)  This  is  c^  Q+f^  ^ -c^ 

Succinctl  y: 

1.  k" 


The  parameters  used  on  this  processor  were: 


N = 256  w = 57.  c = 0.  Pq  ^ ^ Pj  = • 5 ( 4.  25  ) 

with  matrices  A^(jN)=A^  and  3^(jN)=3^  given  by: 


In  (4.25)  the  sample  statistics  were  used  on  w,c,  while  the 
a prior i probability  of  object  presence  or  absence  was 
assumed  equally  likely.  The  initial  conditions 


indicate  the  uncertainty  on  the  intial  estimates  prior  to 

the  reception  of  the  observations.  When  the  processor 

output  was  V , the  estimator  was  reinitialized  to  these 
o 

same  values  before  processing  a new  line  of  observations. 

Results  from  applications  of  said  processor  are 
■lijstrated  in  Figs.  (4.6c),  (4.7c)  and  (4.7d)  where  for 
<r  1*  ,,  the  estimated  bour.dary  (dimmer  trace)  has  been 
• i -in  the  original  ellipse  (brighter  trace).  When 

f the  estimate  and  the  original  has  occurred, 
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the  trace  has  been  left  dim. 


Case  2 : In 
as  in  the 
( estima  to  r ) 


about  s (k) 
o 


this  occasion  the  object  luminance  is  constant 
previous  case,  although  unknown.  The  processor 
has  been  supplied  with  a priori  statistics 
in  the  form  of  the  average  and  variance. 


E S = . 5 
o 


E (S  - E S 
o o 


. 05  . 


Relations  (4.24),  (4.25)  ranain  applicable  as  before, 

however  the  matrices  A(jN)=A  and  B(jN)=3  now  corresoond  to 


with  initial  conditions  given  by 


x(0|0) 


0 

0 

0 


(20^  0 
0 50^ 

0 0 


0 

0 

05 


Fig.  (4.6d)  shows  the  estimated  (as  well  as  the  original) 
boundary  from  application  of  this  3-state  processor  to  the 
observation  shown  in  Fig.  (4.6b). 


Experimental  results  for  the  known  and  unknown 
luminance  cases  showed  minimal  degradation  of  the  estimated 
boundary  obtained  from  the  3-state  as  ooposed  to  the 
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(c)  Orig  - est,  boundaries, 
known  intensities,  1,0,0 


(d)  Orig  ' est.  boundaries, 

unknown  intensities,  1,0,0 


Fig.  4.  C).  Noisy  ellipses  and  processor  outputs  with  known  and 
unknown  object  luminances. 


74 


(c)  Orig  - est.  boundaries, 
known  intensities, 

0, 1000, 1000 


(d)  Orig  - est.  boundaries, 
known  intensities, 

0, 800, 800 


Fig.  4.7.  Noisy  ellipses  (a  = 2.  0 and  a = 3.  0)  and  corresponding 
processor  outputs. 


5 


r ■ 1 


2-state  processor  as  can  be  appreciated  by  comparison  of 
Figs.  (4.6d)  and  (4.6c). 

A different  set  of  256X256  pictures  has  also  been  used 
to  test  the  boundary  processor.  The  original  image 
illustrated  in  Fig.  (4.8a)  with  the  histogram  shown  in 
Fig.  (4.9),  depicts  an  armored  personnel  carrier  (APC)  on  a 
natural  scene.  This  picture  has  been  selected  as  an 
example  of  a realistic  image  and  it  is  available  from  the 
data  base  of  the  University  of  Southern  California  (30]. 
To  test  the  processor  performance  in  textured  environments, 
the  APC  picture  has  been  assumed  to  represent  a binarv 
image . 

Inspection  of  the  histogram  revealed  two  peaks  that 
were  chosen  as  the  "constant”  luminance  values  of  the 
object  and  background  (s^=56,  Sj^  = 132).  With  the  original 
an  8-bit  image,  the  luminance  values  were  linearly  mapped 
into  the  interval  [0,1]  before  addition  of  white  Gaussian 
noise  of  standard  deviation  o , to  generate  the  set  of 
observations  appearing  in  Fig.  (4.8b)  and  Pigs.  (4.10a,b). 
In  displaying  those  observations,  luminances  above  1 were 
set  to  1 and  those  below  0 as  zero  (equivalently  255  and 
0)  . 

The  parameters  for  this  processor,  gathered  by  the 
procedures  indicated  previously  when  estimating  the 


elliptical  boundaries,  were: 
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N = 256  w=75.8  c = -4.  6 Pq  = • ^ ^1  ^ ‘ ^ 

S = . 220  S , = . 518 

o b 

while  the  matrices  A^(jN)=A^,  initial 

conditions  c(0li3)  and  P(0]0)  corresponded  to: 


The  results  for  three  different  noise  levels  appear  in 
Figs.  (4.8c,d)  and  Figs.  (4.10c,d).  In  contrast  to  the 
pattern  followed  in  Figs.  (4.6,7)  where  the  estimated  as 
well  as  the  original  boundaries  were  shown  in  the  same 
picture,  only  the  estimated  boundary  is  shown  in 
Figs.  (4.8,10),  with  tne  exception  of  Fin.  (4.8c)  where  the 
original  boundary  (brighter  trace)  is  also  nrinted. 
Because  the  estimator  provides  at  cverv  line  only  the  wivlth 
and  center  values  (equivalently,  the  initial  md  final 
pixels  the  object  occupies  on  the  line),  to  help  in 
visualizing  the  APC  boundary,  all  the  pixels  on  tne  first 
and  last  lines  belonginn  to  the  estimated  object  have  boon 


I 


shown  as  part  of  the  boundary  too. 
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I 

1 

It  must  be  pointed  out:  (1)  from  Fiq.  (4.8c)  that 

although  the  processor  nas  succesfully  extracted  the  object 
in  the  picture,  it  has  also  identified  the  shadow  on  the 
left  as  belonging  to  the  APC;  this  however,  is  not 
surprising  in  view  of  Fig.  (4.8b)  where  even  visual 
separation  is  difficult.  (2)That  though  the  noise 
variances  for  the  ellipse  cases  were  bigger,  the  luminance  | 

j 

difference  between  background  and  foreground  was  greater  ! 

too.  (3)  That  a single  processor  was  used,  even  though  the  | 

ellipses  were  located  in  different  positions  and  with 

different  orientations.  And  (4)  the  appl icabi 1 i t y of  the 

processor  in  cases  of  severe  noise  degradation.  1 

Exper imental  Remar  ks : Under  this  heading  several  ' 

1 

queries  as  well  as  answers  will  be  considered.  The  answers 
are  mainly  observations  born  out  of  the  experiments,  and 

1 

conclusions  drawn  are  limited  in  this  respect.  | 

I 

It  was  indicated  that  for  the  processor  implemented  j 

i 

before,  the  computation  bulk  was  associated  with  the  , 

I 

estima  tion  stage  . 

Recall  that  for  the  estimator  to  proceed,  it  is  ! 

necessary  to  establish  first  which  one  of  the  interceptions  | 

illustrated  in  Fig.  (4.3)  occurs.  Two  different  ways  to  j 

carry  out  this  classification  correspond  to  an  enumeration 

or  a general  approach.  In  the  second  method,  the 

interception  is  found  from  a set  of  tests  that  locate  the 
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(a)  APC  original 


(c)  Original  and  estimated 
APC  boundaries,  known 
intensities,  1,0,0 


♦ - 


(b)  Noisy  APC,  J = . 1 


(d)  Estimated  APC  boundary, 
known  intensities,  1,0,0 


Fig.  4.8.  Original  APC,  noisy  observation  (3  - . 1 ) and  processor 
output. 


79 


(a)  Noisy  APC,  a = . 6 


(b)  Noisy  APC 


(o)  Estimated  APC  boundary 
known  intensities,  1,0,0 


(d)  Estimated  APC  boundary 
known  intensities, 

0, 260, 260. 


Fig.  4.10.  Noisy  APC  (a  = . 6 and  a =1.2)  and  processor  outputs 


vertices  of  the  rectangular  region  (O)  with  respect  to  the 
boundary  lines  {L  ) derived  from  (2.10).  This  type  of 
search  was  used  in  the  preceding  examples  and  it  is 
appropriate  when  there  is  no  indication  as  to  how  often  the 
different  interceptions  occur.  The  enumeration  approach, 
on  the  other  hand,  produces  a search  directed  by  the 
occurrence  of  the  interceptions.  Under  this  method,  the 
search  is  designed  to  use  a minimum  number  of  tests  to 
establish  whether  the  most  frequent  interception  has 
occurred.  The  other  interceptions  are  tested  in  order  of 
decreasing  occurrence.  Incidentally,  it  was  observed  while 
processing  the  APC  pictures  that  approximately  99%  of  the 
interceptions  corresponded  to  the  one  shown  in  Fig.  (4.2). 
Hence,  if  applied  in  this  instance,  the  enumeration 
approach  should  result  in  a faster  algorithm. 

Another  way  to  speed  up  the  estimator  above,  involves 
the  use  of  a simplified  algorithm.  In  this  case,  the 
search  in  Fig.  (4.3)  is  eliminated.  Instead,  1-4  is 
assumed  to  happen  at  all  times.  This  simplification  can 
result  in  a poorer  estimate  depending  on  the  frequency  of 
appearance  of  the  selected  interception.  Note  that  as  long 
as  the  estimate  error  variances  remain  reasonably  small, 
the  region  Q will  be  small  in  relation  to  A and 
consequently  lie  within  it.  On  the  other  hand,  large  error 
variances  will  tend  to  corresoond  to  the  rest  of  the 


interceptions.  Thus,  when  the  variances 


are 


small , the 


original  as  well  as  the  simplified  algorithms  should  result 


in  very  similar  estimates.  As  the  variances  increase,  the 
simplified  algorithm  should  produce  different  estimates  and 
larger  variances.  Hence,  if  it  is  true  that  larger 
variances  indicate  more  uncertain  estimates,  the  simplified 
estimator  results  in  poorer  estimates.  On  the  processor 
level,  however,  the  estimate  can  be  accepted  or  rejected 
depending  on  a threshold  that  would  be  higher  for  bigger 
variances.  This  would  imoly  a higher  rejection  rate  from 
the  detector.  In  summary,  the  simolified  algorithm 
proposed,  being  faster  than  the  original,  while  degrading 
poor  estimates,  produces  negligible  changes  on  estimates 
wLth  small  associated  variances. 


The  cost  values  chosen  depend  on  the  particular 
processor  application.  As  a result,  onlv  guidelines  to 
make  a selection  can  be  given.  Of  course,  it  is  known  how 
the  different  costs  affect  qualitatively  the  resultinn 
output.  For  example,  the  important  quantities  involved  are 


'1.0  1,0  0,  0 ' 
consideration  to  make 


, (Cq  1 ~ tr  P . A first 

cieals  with  the  relative  values 


associated  with  non-detection  and  false  alarming  or  for 

this  matter,  between  ( c^  ^ j i ) ^nd  (Cj  ^ + f| 

c ).  The  second  consideration  refers  to  the  various 

0,  0 

degrees  of  emphasis  that  can  be  applied  on  the  estimation 


covariance  trace.  In  finding  an  answer  to  the  detection 
vs.  estimation  consideration  it  was  found  that  under  low- 
noise  conditions  high  penalties  of  detection  were  a good 
choice;  this  in  turn  corresponded  to  setting  the  variable 
threshold  near  1 (zero  if  logarithms  are  used)  when  equal 
weights  were  put  on  either  wrong  detector  decision.  In 
noisier  environments,  however,  the  constant  threshold 
detector  proved  to  be  useless.  Under  severe  noise 
conditions,  the  covariance  trace  needs  to  be  taken  into 
consideration.  Detection  costs  too  high  will  produce  poor 
estimates;  costs  too  low  will  miss  the  object  completely 
because  the  covariance  term  will  raise  the  threshold  too 
high.  In  general,  it  is  convenient  to  start  with  low  costs 
and  raise  them  until  satisfactory  results  are  obtained. 


This  chapter  concludes  with  the  presentation  in 
Fig.  (4.11)  of  the  flow  chart  for  the  boundary  processor  of 
binary  images  with  known  luminance  values.  The  flow  chart 
for  unknown  levels  can  be  obtained  by  simple  modifications 
of  F ig  . (4.11). 


I.  c. 

j.k  = 1 


Use  Eqs.  (3.17),  (3.18)  to 
obtain  P(k|k-1),  f(klk-l). 


Use  P(k|k-1),  r(klk-l), 
w,  c to  find  □,  p [r(k)]. 


Find  □ n A (see  Fig.  (4.  3)). 
Adjust  p fr(k)]  if  □ ^ A ^ O . 

Si 


Find  a mosaic  of  polygons  from  Fig.  (4.4) 
matching  (onA)7,  (X^O)  and  (□  H A)  U (\  = 1 ). 


Add  contributions  from  each  polygon 
to  evaluate  relations  (4.  12). 


Use  y(k)  to  evaluate  exponentials  in  (4.2),  (4.3). 

Combine  with  values  from  (4.12)  to  obtain  P(k|k). 

f(k|k).  Update  In  L;  > . 

J > ^ 


Fig.  4.11.  Flow  chart  for  boundary  processor  for  binary  Images 
of  known  luminance. 


CHAPTER  FIVE 


! 

I 

p 

i 

I Conclusions,  Comments  and  Further  Work 

1'  A comparison  between  the  processor  derived  in  this 
work  and  the  boundary  estimator  in  [33]  (see  Fio.  (5.1  )) 
can  now  be  made.  It  should  be  noted  that  both  estimators 
are  identical  while  the  detectors  are  not.  Two  new 

elements  are  present  in  Fiq.  (5.1)  that  were  not  oart  of 
the  processor  in  chapter  three.  The  switch  on  the  left 
closes  after  the  line  estimates  are  comouted.  The  line 
storaqe  is  necessary  for  the  detector  to  be  able  to  use 
oart  of  the  observation  sequence  to  make  a decision  after 
the  estimates  are  available.  The  estimates  in  turn,  serve 
to  determine  which  part  of  the  observation  the  detector 
will  use  and  which  part  will  be  disreqarded  in  oerforminq 
the  acceptance  or  rejection  test.  The  subscript  on  the 
likelihood  ratio  ( gst ) calculated  in  (331  as  well  as  the 
arrow  stemminq  from  the  estimator  serve  to  ooint  explicitly 
this  dependence  on  the  estimated  values.  The  main 
disadvantaqe  associated  with  this  boundary  estimator  is  the 
line  storaqe  required. 

Other  structures  to  perform  boundarv  estimation  in  the 
context  of  joint  detection  and  estimation  can  be  orooosed. 
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Fig.  (5.2),  for  instance,  illustrates  a processor  that 
uses  a function  of  the  observations  at  the  detector  imput. 
Letting 


jN 

Y (j)  = 'V  y(k)  . 

® ^k  = (j-l)N+l 


The  joint  cost  of  estimation  and  detection  for  some 
chosen  cost  function  can  be  written  as: 


* P^^sl'V  ' P|  Pl^l" 


5.  2 ) 


where 


'l,  ° PlC‘‘''f%st-  ■■lPlHV.M,)|[idY  pdln, 

= P|  P<YjH,)[;dr[r^^,-  r|p(r|Y,II,)| 


( 5.  3 


where  the  integration  in  (5.3)  on  Y is  performed  over  all  Y 
such  that  (5.1)  is  satisfied. 


The  value  of  i minimizing  (5.3)  and  consequently 
est 

(for  a fixed  decision  rule)  (5.2),  corresponds  to: 


r'UNi  Y(j»l  = Kf  r(jN)|  Y(j)  . H 


tr  P ' dr[r  -r|[r  - r]p(rlY,II  ) . 


( 5.4  ) 


J 
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The  cjptimal  decision  rule  obtained  after  some 
simplification  reduces  to: 


if 

then 


"O.l  - ^"l.l  + tr  P ) > 0 


Pi  > 


1 


0 


c f f - c 

1,0  1,0  0,0 


( 5.  5a  ) 


( 5.  5b  ) 


decide  v if 

^0 


'o.l  ■ <‘=1,1"“'  P I ‘ ■ 


( 5.  5c  ) 


Notice  in  particular  the  very  simple  detector  (no 

N-dimensional  densities  involved  as  was  the  case  in  chapter 

three) . A processor  of  this  type  should  be  desirable  in 

cases  where  the  statistics  of  Y are  directly  available  or 

s 

are  easy  to  obtain. 

Let  us  indicate  at  this  point,  that  the  list  of 
boundary  processors  cited  throughout  this  work  has  by  no 
means  been  an  exhaustive  enumeration.  On  the  contrary,  it 
is  intended  to  awake  the  interest  in  this  form  of 
estimation  and  to  express  the  need  for  a complete 
classification  of  processors  in  terms  of  cost  functions, 
applications  (uses),  capabilities,  advantages  and 
disadvantages . 

Let  us  refer  to  the  two  main  restrictions  imposed  on 
the  images:  two-textured  and  horizontally  convex  obiects. 
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Note  first  that,  sayinq  an  image  has  two  textures  is 
not  the  same  as  sayinq  it  is  a binary  valued  picture,  i.e., 
zeros  and  ones.  Indeed,  the  representation  (1.6)  has  often 
been  used  in  the  past  when  dealing  with  monochrome 
multi-valued  images  [21,24,26,31],  and  it  can  be  used  to 
model  each  of  the  textures,  when  reoresentinq  images  by 
replacement  processes.  Viewed  in  this  way,  the  model 
associated  with  (1.6)  can  be  interpreted  as  a oarticular 
and  degenerate  case  of  the  replacement  formulation  where 
only  one  texture  is  involved  (it  covers  the  entire 
picture).  Hence,  the  fidelity  achieved  in  reoresentinq 
images  as  composed  of  two  or,  by  the  same  token,  more 
textures  is  very  dependent  on  the  designer  emohasizing 
complexity  of  texture  model  with  reduced  number  of  textures 
or  simplicity  in  texture  model  but  allov;inq  additional 
textures  to  be  present. 

It  is  convenient  to  recall,  that  it  is  the  horizontal 

convexity  constraint  which  is  the  factor  that  reduces  the 

problem  of  boundary  determination  to  the  estimation  of  only 

two  parameters:  w(k)  and  c(k).  When  this  restriction  does 

not  apply,  then  it  is  necessary  to  redefine  relations  (2.9) 

appropriately.  One  way  to  proceed  is  to  associate  more 

than  one  pair  of  parameters  to  the  replacement  function  \ 

as  many  as  required  by  the  classes  of  objects  investigated, 

e.g.,  for  images  containing  objects  like  the  one  depicted 

in  Fig.  (2.2a)  four  parameters  suffice.  Clearly  as  the 
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number  of  parameter  oairs  increases,  so  does  the  orocessor 


size  (total  amount  of  computation).  The  case  of 
multi-textured  imaqes  is  dealt  with  similarly.  However, 
instead  of  associatinq  several  width  and  center  oairs  to 
the  replacement  function  \ , now  each  X.  , carries  a oair 
(w^  . c^  ) associated  to  it 

A topic  for  future  investiqation  consists  in  the 
computational  reouirements  for  imaqes  with  textures  modeled 
by  dynamic  systems  of  biqqer  dimensionality  than  those 
considered  in  the  applications,  i.e.  < 2.  It  is  of 

considerable  importance  too,  to  establish  the  sensitivity 
of  the  algorithm  to  different  densities  o^lx(k)l,  and  at 
the  same  time  the  available  simplifications  derived  from 
the  use  of  these  densities. 


Summarv 


A solution  to  the  problem  of  boundary  determination, 
an  important  topic  in  automated  imaqe  unde r stand  i nq , has 
been  presented.  The  imaqes  considered  were  composed  of  two 
textures  (a  horizontally  convex  obiect  on  a background)  and 
were  characterized  statistically.  An  optimal  boundary 
estimator  has  been  derived  by  minimizing  the  average  cost 
of  joint  detection  and  estimation  for  aooroor iate 1 v chosen 
cost  functions. 

P3 
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Furthermore,  in  view  of  information  restrictions, 
recursive  easily  imol ementable  alqorithms  updatinq  only 
first  and  second  order  moments  were  developed  to  carry  out 
the  tasks  of  estimation  and  detection.  Applications  to 
pictures  of  a military  vehicle  and  computer  generated 
objects  have  been  presented.  Finally,  ways  to  relax  the 
constraints  were  indicated  as  well  as  other  types  of 
possible  candidate  processors. 
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APPENDIX  A 


For  illustrative  purposes  and  to  serve  as  a comparison 
with  the  quadratic  error  cost  boundary  processor,  two 
additional  problems  involving  simultaneous  detection  and 
estimation  are  considered  in  the  following.  The  set  of 
observations  is  assumed  to  be^^^ 


: y(k)  = v(k) 

: y(k)  = s(k)  + v(k) 


( A.  1 ) 


with  s(k)  representing  a known  signal  dependent  on  a 
parameter  r that  needs  to  be  estimated  from  the  set  of 
observations  k=l,..,,N.  It  is  also  assumed  that  all 
necessary  statistics  are  known  and  available.  Of 
particular  interest  are  the  processor  structures. 

Case  1;  Let  the  set  of  costs  be  given  by: 


H 


0 


c 


Lo 


r 

est 


(1)  To  facilitate  tne  comparison,  most  of  the  symbols  used 
in  the  appendix  and  the  main  text  are  identical.  There  can 
be  slight  differences  in  meaning  though. 
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The  average  cost  of  joint  detection  and  estimation 
corresponds  to: 


+ ^^(Vq|Y)[Pj  ‘^01  ^ P(Ylr,Hj)  > r 

+ 6K,|Y)p„[c,  o*t,,olP<’'l%l 

+ 6(v,|Y)  Pi<(c,  ,+  t,,(r  - - r 

p(Y|r,Hj)>r]  . 

( A.  2 ) 

Hence , 

+ Pj  *=01  ^ p(Ylr,Hj)  > r] 

t ‘<V,lY)lp„(c,  „+f,  ,,1  p(YlH^) 

* Pi  ""['1,1*  'll*"  - • 


L 


( A.3  ) 
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[ while  the  optimal  decision  rule  6'  becomes: 

[ = 0 . 6*(vj|Y)  = 1 

, 

PlvlH])  s <r'r 

p(Y|r.H,)>r  = Pj,c„^^p(Y|H„l  t 
Pi  r'  + tr  p')  p(Y1Hj)  . 

Collecting  terms, 

I Pi  '■  ^ ^ ' ■ '"'i,  1 ' ^1 1 ^ p(y1  up 

[ Therefore,  the  optimal  detector  decisions  are: 

► 

I 

! 

r 

; 6'(v,|Y)  = 1 

' ^''(YoIy)  = 0 


K > 0 
c 


if 


and 


A.  5 
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6 (VqIY)  = 1 

6'^yJY)  = 0 


if 


or 


K > 0 
c 


and 


N 


< k" 


where , 


= 'oi  ^ ■■  - 


K = (c.  „ + f,  „ - c„  /K 
1,0  1,0  0,  o'  c 


P,  P(YlHj) 
Po  PIV|H(,) 


( A . 6 ) 


( A.  7 ) 


Consequently,  the  processor  above  has  the  structure 

indicated  in  Fiq.  (3.2),  the  estimator  being  identical  to 

that  in  (3.7)  while  the  detector,  although  defined  from 

relations  equivalent  to  (3.2),  (3.13)  differs  in  the 

definition  of  K . 

c 

Case  2:  \ cost  function  aopropriate  for  estimating 


energy-type  parameters  is  the  following: 


The  set  of  observations  is  as  qiven  in  (A.l).  In  this 

instance,  wrong  detection  decisions  are  penalized  Cj,  but 

no  cost  is  incurred  if  the  decisions  are  correct.  Two 

possible  estimates  are  presented  at  the  processor  output: 

when  the  detector  decides  on  ^ , an  estimate  of  zero  is 

0 

produced;  otherwise,  >^est  outputed.  The  processor  is 

illustrated  in  Fig.  (Al).  Proceeding  as  in  Case  1: 

^D  + E ^ .J  I 6(VqI  V)  Pj  < (c f f r r)  p(Y|  r,  ) > r 

t 6(y,|YI  , f p(Y|H„l  ( A.  P 1 

+ 6(v,|Y)Pjf<(r  - (r  - p(V|  r,  ) > r}  . 

r-li nimiza t ion  of  R is  equivalent  to  minimizinq  R,  : 

D f E df e 

*Pl  < (^1  + f *-'r)  P(Ylr.Hj)  > r} 

f 5(v,|Y)|pq  Cj  p(Y|Hq)} 

* 'IPo  %»,  '•es, 

tp  <(r-r  )(r-r  Jp(Y|r,H)>r}.  (A.  10) 

1 est  est  I 

1 05 


In 


(A. Ik))  only  the  terms  inside  the  last  braces  depend  on 

r . Hence,  assuming  a fixed  decision  rule,  is 

est 

minimized  by  choosing  r^^^  equal  to: 


r'"'[NlY]  = — 

N 


Y E[r(N)|Y.Hj]  . 


A.  11  ) 


With  as  in  (A. 7).  Replacing  r in  (A. 10)  by  r 

from  (A. 11),  the  optimal  decision  rule  follows: 


decide  vj  if: 


Pq  P<y|Hq)  + f IPq  r"  r "'  p(y1Hq) 

+ p^<(r-r"')(r-r')p(Y|r,Hj)>r] 

s Pi  < (c  1 + f r r)  p(Y  1 r,  Hj ) > r . 


Which  can  be  rearranged  as: 


6‘  (vilY) 


6'''(VolY)  = 


{ A. 12  ) 


6^VolY)  = 

6''(y,1Y)  = 


( A. 13  ) 


where 


r’l  = E[  r(N)lY.Hi  ] 


( A. 14  ) 


K 


'i  + '-'i  ■'i 


( A.  15  ) 


This  optimal  processor  is  illustrated  in  Fig.  {^2) . 
Note  that  (A. 14)  and  (A. 4)  correspond  to  the  same 
estimator,  but  (A. 11)  is  only  a fraction  of  the  estimator 
(A. 14).  This  fraction  being  equal  to  the  a posteriori 
probability  of  occurence  of  hypothesis  H given  the  set  of 
observations  [66] . Some  other  cost  functions  have  been 
considered  in  (39,40,43);  although  the  estimators  have  the 
form  in  (A. 11),  the  detector  relations  are  much  more 
compl icated . 


